-- Logs begin at Tue 2022-10-04 09:41:12 UTC, end at Tue 2022-10-04 10:59:16 UTC. -- Oct 04 10:26:20.538464 dv-cinder-859193-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 10:26:20.547824 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 10:26:20 2022] *** Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: nodename: dv-cinder-859193-3-iscsi Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: machine: x86_64 Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: clock source: unix Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: pcre jit disabled Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: detected number of CPU cores: 4 Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: current working directory: / Oct 04 10:26:20.549203 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: detected binary path: /usr/bin/uwsgi-core Oct 04 10:26:20.549927 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: your processes number limit is 47680 Oct 04 10:26:20.549927 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: your memory page size is 4096 bytes Oct 04 10:26:20.549927 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: detected max file descriptor number: 2048 Oct 04 10:26:20.549927 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: lock engine: pthread robust mutexes Oct 04 10:26:20.549927 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: thunder lock: enabled Oct 04 10:26:20.549927 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 10:26:20.549927 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 10:26:20.589494 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: Python main interpreter initialized at 0x5565ba6b49c0 Oct 04 10:26:20.589494 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: python threads support enabled Oct 04 10:26:20.589494 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: your server socket listen backlog is limited to 100 connections Oct 04 10:26:20.589494 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: your mercy for graceful operations on workers is 90 seconds Oct 04 10:26:20.589847 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 10:26:20.589938 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: *** Operational MODE: preforking *** Oct 04 10:26:20.590152 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: *** uWSGI is running in multiple interpreter mode *** Oct 04 10:26:20.590152 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: spawned uWSGI master process (pid: 106089) Oct 04 10:26:20.590341 dv-cinder-859193-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 10:26:20.592266 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: spawned uWSGI worker 1 (pid: 106090, cores: 1) Oct 04 10:26:20.592266 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: spawned uWSGI worker 2 (pid: 106091, cores: 1) Oct 04 10:26:20.592266 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 10:26:21.259438 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:26:21.265966 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:26:22.341874 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:26:22.341874 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: from cryptography.utils import int_from_bytes Oct 04 10:26:22.342492 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:26:22.342492 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: from cryptography.utils import int_from_bytes Oct 04 10:26:22.351487 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:26:22.351487 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: from cryptography.utils import int_from_bytes Oct 04 10:26:22.351984 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:26:22.351984 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: from cryptography.utils import int_from_bytes Oct 04 10:26:24.859471 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:26:24.860557 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:26:24.860946 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:26:24.861039 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:26:24.861129 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:26:24.861211 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:26:24.861300 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:26:24.861390 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:26:24.861479 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:26:24.861621 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:26:24.861761 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.862012 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.862116 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.862323 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.862444 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.862638 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.862744 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.862953 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.863097 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.863257 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.863344 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.863569 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.863665 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.863880 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.863980 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.864204 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.864304 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.864452 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.864539 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.864761 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.864890 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.865105 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.865191 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-3-iscsi {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.865418 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.865518 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-3-iscsi {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.865722 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.865831 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.866023 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.866111 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.866331 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.866423 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.866626 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.866721 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.866942 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.867027 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.867239 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.867331 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.867556 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.867726 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.868064 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.868207 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.868376 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.868502 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.868683 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.868798 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.869029 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.869147 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.869366 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.869467 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.869672 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.869757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.869980 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.870065 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.870281 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.870367 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.870595 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.870746 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.870901 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.871044 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.871215 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.871313 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-3-iscsi {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.871587 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.871683 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-3-iscsi {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.871893 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.871988 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.872199 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.872293 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.872509 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.872618 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.872921 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.873015 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.873228 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.873331 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.873537 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.873629 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.873862 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.874029 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.874185 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.874355 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.874489 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.874623 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.874780 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.874999 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.875137 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.875613 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.875774 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.875908 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.876048 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.876203 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.876354 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.876489 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.876637 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.876770 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.876770 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.877076 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.877076 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.877336 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.877471 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.877605 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.877749 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.877891 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878036 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878172 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878325 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878483 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878587 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878672 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878815 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.878907 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.879064 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.879154 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.879311 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.879414 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.879612 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.879699 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.879925 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.880025 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.880229 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.880316 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.880531 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.880617 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.880831 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.880998 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.881158 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.881268 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.881458 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.881546 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.881761 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.881849 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.882062 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.882147 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.882365 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.882465 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.882671 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.882753 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.882978 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.883082 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.883292 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.883378 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.883592 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.883679 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.883923 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.884018 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.884227 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.884346 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.884533 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.884635 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.884834 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.884948 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.885190 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.885288 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.885503 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.885596 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.885806 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.885908 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.886123 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.886232 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.886438 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.886524 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.886740 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.886826 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.887040 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.887135 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.887340 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.887426 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.887643 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.887728 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.887968 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.888132 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.888262 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.888363 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.888508 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.888604 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.888802 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.888908 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.889128 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.889217 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.889429 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.889514 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.889725 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.889821 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.890026 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.890125 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.890325 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.890414 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.890619 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.890707 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.891503 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.891657 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.891741 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.891857 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.892134 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.892224 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.892444 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.892531 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.892743 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.892950 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.893070 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.893158 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.893370 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.893495 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.893670 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.893774 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.893968 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.894131 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.894266 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.894362 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.894568 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.894677 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.894880 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.894976 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.895181 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.895268 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.895479 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.895580 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.895777 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.895866 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.896079 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.896181 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.896378 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.896474 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.896674 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.896772 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897003 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897093 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897307 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897411 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897604 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897690 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897903 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.897991 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.898205 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.898300 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.898501 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.898586 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.898800 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.898886 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.899103 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.899198 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.899396 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.899490 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.899697 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.899786 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.899998 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.900095 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.900298 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.900395 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.900596 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.900692 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.900915 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.901006 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.901216 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.901303 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.901517 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.901632 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.901799 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.901885 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.902100 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.902187 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.902399 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.902487 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.902690 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.902778 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.902987 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.903086 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.903304 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.903401 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.903603 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.903689 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.903903 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.903989 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.904200 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.904298 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.904504 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.904590 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.904826 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:26:24.904958 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.905172 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.905268 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.905505 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.905599 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.905814 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.905900 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.906142 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.906251 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.906471 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.906585 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.907353 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.907548 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.907702 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.907874 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.907963 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.908192 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.908279 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.908509 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.908604 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.908839 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.908946 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.909166 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.909251 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.909478 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.909577 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.909790 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.909904 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.910109 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.910196 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.910419 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.910513 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.910733 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.910824 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.911049 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.911144 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.911355 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.911451 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.911668 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.911754 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.911976 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.912062 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.912295 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.912400 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.912601 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.912689 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.912957 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.913106 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.913276 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.913373 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.913591 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.913677 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.913911 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.913998 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.914226 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.914314 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.914532 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.914618 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.914837 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.914923 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.915142 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.915238 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.915476 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.915562 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.915778 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.915871 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.916084 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.916171 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.916396 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.916486 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.916701 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.916797 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.917047 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.917136 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.917359 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.917444 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.917666 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.917767 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.917971 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.918058 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.918276 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.918364 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.918580 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.918675 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.918891 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.918976 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.919205 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.919298 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.919518 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.919612 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.919827 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.919922 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.920132 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.920219 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.920444 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.920531 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.920749 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.920835 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.921149 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.921240 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.921456 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.921545 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.921755 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.921849 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.922055 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.922174 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.922394 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.922524 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.922859 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.922947 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.923175 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.923261 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.923492 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.923581 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.923802 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.923888 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.924116 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.924201 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.924446 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.924542 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.924745 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.924831 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.925079 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.925249 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.925388 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.925486 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.925695 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.925782 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.925996 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.926097 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.926303 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.926443 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.926606 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.926692 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.926903 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.926999 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.927218 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.927305 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.927523 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.927609 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.927826 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.927922 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.928145 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.928230 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.928442 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.928528 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.928746 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.928834 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.929080 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.929168 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.929385 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.929470 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.929693 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.929782 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.930000 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.930086 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.930305 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.930391 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.930615 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.930702 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.930920 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.931005 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.931225 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.931318 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.931539 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.931626 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.931850 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.931936 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.932149 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.932249 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.932469 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.932557 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.932790 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.932983 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.933129 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.933229 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.933430 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.933529 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.933735 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.933822 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.934035 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.934140 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.934337 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.934424 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.934636 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.934730 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.934944 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.935077 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.935240 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.935333 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.935538 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.935625 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.935834 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.935922 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.936133 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.936219 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.936432 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.936561 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.936737 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.936824 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.937063 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.937151 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.937366 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.937452 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.937664 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.937783 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.938102 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.938194 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.938449 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.938545 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.938753 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.938841 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.939090 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.939177 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.939396 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.939491 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.939722 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.939809 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.940038 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.940125 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.940346 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.940441 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.940657 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.940750 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.940987 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.941077 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.941294 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.941411 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.941601 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.941698 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.941905 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.942048 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.942214 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.942311 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.942518 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.942612 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.942832 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.942927 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.943136 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.943223 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.943452 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.943550 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.943754 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.943840 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.944067 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.944162 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.944367 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.944453 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.944676 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.944762 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.945002 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.945091 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.945327 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.945418 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.945647 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.945731 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.945964 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.946052 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.946270 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.946357 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.946578 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.946664 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.946883 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.946978 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.947193 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.947280 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.947498 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.947594 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.947802 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.947888 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.948107 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.948198 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.948408 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.948503 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.948718 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.948813 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.949048 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.949152 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.949364 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.949459 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.949666 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.949759 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.949976 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.950062 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.950276 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.950371 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.950584 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.950670 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.950887 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.950980 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.951201 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.951289 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.951510 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.951595 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.951816 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.951913 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.952131 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.952219 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.952436 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.952771 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.953035 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.953123 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.953844 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.953975 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.954174 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.954262 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.954472 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.954658 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.954824 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.954971 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.955058 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.955280 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.955593 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.955681 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.955916 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.956004 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.956227 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.956313 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.956532 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.956619 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.956830 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.956978 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.957151 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.957254 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.957457 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.957544 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.957764 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.957911 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.958069 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.958155 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.958377 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.958477 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.958693 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.958788 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.958992 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.959088 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.959292 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.959379 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.959609 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.959694 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.959912 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.960011 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.960209 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.960303 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.960508 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.960594 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.960809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.960959 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.961145 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.961231 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.961453 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.961539 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.961751 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.961845 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.962063 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.962150 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.962379 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.962475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.962683 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.962770 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.962989 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.963074 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.963295 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.963382 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.963597 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.963697 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.963911 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.964003 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.964215 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.964304 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.964520 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.964608 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.964825 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.964930 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.965154 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.965240 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.965460 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.965549 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.965765 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.965860 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.966073 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.966166 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.966372 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.966458 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.966677 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.966770 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.966983 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.967083 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.967282 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.967368 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.967585 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.967671 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.967892 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.967989 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.968199 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.968453 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.968539 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.968781 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.968909 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.969694 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.970087 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.970175 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.970435 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.970521 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.970750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.970850 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.971074 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.971161 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.971395 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.971480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.971704 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.971806 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.972006 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.972107 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.972313 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.972400 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.972615 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.972701 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.972937 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.973047 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.973245 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.973333 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.973548 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.973642 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.973848 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.973944 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.974149 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.974235 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.974453 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.974547 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.974751 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.974848 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.975048 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.975134 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.975345 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.975431 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.975648 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.975738 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.975959 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.976044 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.976259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.976353 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.976564 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.976651 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.976874 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.977000 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.977199 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.977285 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.977504 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.977591 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.977808 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.977894 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.978104 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.978200 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.978401 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.978489 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.978726 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.978819 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.979023 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.979182 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.979324 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.979409 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.979668 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.979754 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.979976 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.980072 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.980291 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.980376 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.980591 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.980678 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.980932 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.981025 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.981236 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.981334 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.981534 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.981620 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.981829 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.981917 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.982133 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.982220 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.982436 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.982529 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.982733 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.982821 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.983035 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.983123 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.983337 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.983423 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.983638 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.983724 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.983936 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.984021 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.984232 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.984327 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.984535 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.984792 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.984945 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.985030 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.985182 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.985280 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.985494 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.985581 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.985807 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.985912 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.986123 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.986220 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.986425 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.986511 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.986727 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.986820 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.987022 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.987165 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.987325 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.987420 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.987627 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.987713 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.987927 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.988021 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.988222 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.988321 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.988521 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.988608 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.988817 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.988926 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.989147 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.989235 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.989450 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.989536 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.989743 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.989830 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.990051 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.990144 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.990351 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.990436 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.990648 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.990736 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.990946 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.991032 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.991249 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.991345 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.991545 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.991708 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.991843 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.991931 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.992145 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.992241 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.992445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.992579 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.992750 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.992837 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.993072 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.993174 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.993375 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.993463 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.993674 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.993763 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.993972 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.994078 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.994269 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.994403 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.994569 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.994655 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.994863 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.994949 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.995159 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.995245 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.995454 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.995547 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.995752 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.995848 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.996048 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.996134 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.996346 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.996438 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.996651 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.996739 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.996969 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.997070 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.997272 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.997361 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.997572 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.997660 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.997876 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.997970 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.998182 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.998278 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.998487 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.998573 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.998818 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.998904 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.999123 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.999216 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.999435 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.999520 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.999741 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:24.999827 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.000046 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.000148 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.000408 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.000511 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.000712 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.000801 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.001169 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.001277 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.001488 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.001576 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.001794 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.001881 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.002111 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.002207 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.002414 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.002509 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.002726 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.002815 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.003030 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.003118 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.003332 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.003426 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.003647 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.003733 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.003956 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.004050 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.004266 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.004361 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.004563 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.004659 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.004877 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.004968 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.005194 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.005283 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.005498 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.005585 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.005802 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.005890 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.006107 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.006194 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.006414 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.006510 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.006721 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.006807 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.007025 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.007110 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.007332 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.007509 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.007635 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.007723 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.007938 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.008025 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.008243 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.008345 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.008547 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.008641 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.008845 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.008971 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.009177 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.009272 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.009484 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.009569 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.009783 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.009869 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.010088 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.010182 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.010388 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.010475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.010692 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.010777 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.010988 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.011076 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.011296 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.011407 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.011608 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.011715 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.011913 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.012022 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.012322 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.012407 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.012628 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.012759 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.012956 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.013049 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.013263 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.013348 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.013570 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.013666 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.013870 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.013958 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.014183 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.014269 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.014498 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.014645 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.014805 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.014892 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.015155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.015242 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.015454 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.015550 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.015751 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.016493 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.016648 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.016738 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.016981 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.017086 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.017288 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.017441 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.017599 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.017685 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.017925 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.018021 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.018233 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.018319 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.018539 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.018624 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.018846 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.019448 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.019537 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.019617 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.019697 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.019784 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.019876 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.019957 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.020179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.020275 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.020497 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.020584 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.020810 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.020950 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.021154 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.021256 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.021476 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.021586 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.021799 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.021898 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.022103 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.022203 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.022413 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.022511 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.022720 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.022841 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.023039 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.023147 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.023356 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.023453 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.023664 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.023762 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.023976 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.024074 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.024277 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.024365 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.024600 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.024756 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.024933 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.025029 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.025228 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.025323 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.025557 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.025665 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.025875 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.025963 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.026196 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.026284 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.026521 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.026609 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.026861 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.026947 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.027184 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.027273 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.027486 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.027581 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.027787 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.027873 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.028094 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.028180 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.028400 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.028489 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.028700 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.028787 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.029044 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.029135 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.029346 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.029435 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.029651 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.029736 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.029955 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.030050 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.030261 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.030348 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.030561 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.030647 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.030860 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.030959 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.031167 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.031253 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.031476 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.031586 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.031830 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.031932 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.032140 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.032235 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.032461 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.032549 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.032780 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.032906 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.033111 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.033219 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.033429 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.033517 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.033735 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.033831 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.034035 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.034122 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.034334 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.034421 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.034634 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.034722 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.034958 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.035055 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.035259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.035354 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.035560 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.035649 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.035885 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.035970 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.036199 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.036286 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.036502 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.036594 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.036831 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.036992 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.037177 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.037275 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.037488 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.037575 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.037792 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.037894 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.038105 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.038206 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.038430 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.038530 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.038731 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.038820 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.039031 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.039127 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.039336 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.039423 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.039634 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.039721 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.039934 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.040051 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.040231 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.040331 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.040533 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.040620 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.040828 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.040953 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.041150 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.041249 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.041448 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.041535 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.041749 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.041901 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.042050 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.042138 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.042351 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.042437 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.042658 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.042746 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.042958 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.043046 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.043260 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.043359 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.043556 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.043652 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.043862 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.043949 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.044169 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.044265 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.044474 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.044561 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.044777 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.044898 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.045119 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.045224 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.045432 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.045520 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.045740 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.045826 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.046049 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.046147 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.046360 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.046447 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.046671 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.046763 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.046983 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.047639 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.047821 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.047912 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.048128 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.048215 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.048443 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.048532 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.048754 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.048840 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.049093 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.049192 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.049412 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.049655 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.049750 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.049982 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.050069 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.050294 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.050541 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.050630 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.050875 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.050962 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.051192 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.051279 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.051498 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.051593 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.051804 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.051904 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.052110 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.052206 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.052415 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.052501 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.052720 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.052807 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.053054 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.053156 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.053368 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.053458 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.053681 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.053776 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.054009 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.054104 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.054324 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.054410 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.054635 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.054723 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.054945 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.055034 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.055255 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.055534 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.055626 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.055720 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.055903 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.056199 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.056301 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.056508 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.056606 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.056897 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.057003 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.057148 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.057249 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.057454 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.057558 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.057812 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.057927 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.058067 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.058175 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.058379 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.058478 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.058687 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.058829 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.058991 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.059134 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.059298 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.059442 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.059607 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.059742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.059916 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.060063 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.060229 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.060375 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.060540 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.060674 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.060848 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.060991 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.061179 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.061269 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.061490 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.061577 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.061824 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.062000 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.062165 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.062308 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.062440 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.062634 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.062804 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.063037 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.063328 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.063485 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.063643 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.063731 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.063953 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.064040 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.064276 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.064374 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.064575 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.064663 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.064896 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.065028 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.065205 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.065305 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.065510 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.065610 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.065807 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.065905 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.066124 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.066213 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.066430 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.066517 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.066729 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.066832 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.067031 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.067127 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.067331 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.067426 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.067710 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.067867 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.067964 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.068200 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.068298 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.068509 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.068607 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.068829 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.069096 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.069186 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.069446 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.069547 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.069765 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.069854 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.070083 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.070173 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.070384 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.070473 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.070684 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.070774 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.070995 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.071082 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.071298 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.071387 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.071597 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.071686 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.071895 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.071984 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.072198 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.072296 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.072501 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.072589 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.072799 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.072919 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.073128 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.073225 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.073421 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.073509 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.073734 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.073821 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.074030 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.074128 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.074332 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.074421 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.074632 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.074718 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.074933 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.075022 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.075232 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.075325 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.075532 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.075630 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.075830 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.075921 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.076128 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.076217 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.076430 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.076517 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.076726 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.076814 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.077054 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.077139 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.077352 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.077449 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.077912 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.078022 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.078214 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.078348 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.078600 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.078680 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.078840 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.078939 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.079151 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.079248 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.079473 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.079581 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.079749 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.079838 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.080059 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.080155 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.080364 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.080462 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.080681 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.080778 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.081008 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.081100 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.081312 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.081413 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.081627 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.081715 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.081945 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.082032 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.082475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.082566 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.082810 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.082899 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.083133 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.083231 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.083464 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.083727 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.083816 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.084071 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.084159 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.084371 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.084460 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.084674 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.084762 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.085016 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.085126 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.085325 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.085426 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.085633 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.085721 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.085939 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.086036 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.086244 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.086331 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.086566 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.086663 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.086856 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.086954 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.087161 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.087298 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.087466 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.087562 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.087771 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.087870 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.088084 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.088233 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.088382 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.088470 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.088687 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.088784 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.089017 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.089111 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.089322 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.089410 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.089630 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.089719 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.089943 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.090031 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.090256 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.090352 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.090564 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.090652 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.090873 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.090960 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.091186 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.091273 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.091490 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.091582 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.091794 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.091881 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.092096 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.092199 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.092398 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.092486 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.092706 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.092793 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.093044 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.093152 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.093358 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.093447 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.093667 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.093837 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.094608 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.094843 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.094964 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.095200 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.095306 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.095518 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.095667 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.095836 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.096144 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.096233 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.096463 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.096551 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.096783 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.096894 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.097114 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.097202 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.097433 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.097534 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.097737 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.097835 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.098061 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.098154 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.098375 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.098480 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.098696 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.098792 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.099011 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.099106 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.099308 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.099404 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.099609 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.099718 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.099913 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.100009 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.100215 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.100312 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.100528 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.100637 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.100833 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.100938 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.101166 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.101263 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.101463 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.101550 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.101768 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.101862 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.102066 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.102157 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.102365 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.102452 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.102663 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.102758 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.102961 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.103050 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.103264 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.103351 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.103558 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.103646 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.103856 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.103945 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.104154 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.104241 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.104452 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.104549 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.104749 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.104845 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.105071 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.105161 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.105373 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.105468 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.105673 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.105786 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.105971 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.106061 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.106268 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.106368 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.106569 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.106658 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.106867 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.106954 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.107169 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.107265 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.107474 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.107570 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.107780 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.107868 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.108086 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.108202 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.108397 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.108503 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.108716 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.108815 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.109047 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.109147 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.109365 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.109461 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.109752 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.109897 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.110084 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.110312 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.110489 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.110627 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.110822 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.110961 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.111152 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.111272 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.111473 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.111582 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.111785 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.111882 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.112123 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.112211 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.112438 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.112532 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.112754 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.112850 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.113095 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.113227 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.113410 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.113506 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.113709 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.113806 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.114019 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.114106 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.114330 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.114416 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.114646 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.114742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.114958 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.115045 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.115266 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.115353 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.115586 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.115673 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.115888 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.115977 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.116193 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.116288 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.116500 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.116595 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.116807 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.116914 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.117138 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.117238 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.117448 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.117549 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.117754 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.117854 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.118058 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.118160 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.118369 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.118507 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.118679 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.118784 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.118988 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.119089 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.119300 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.119387 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.119603 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.119689 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.119919 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.120007 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.120237 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.120323 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.120560 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.120655 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.120883 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.120975 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.121217 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.121311 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.121540 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.121629 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.121849 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.121938 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.122157 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.122244 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.122456 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.122552 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.122694 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:26:25.122830 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.123146 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.123460 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.123765 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:26:25.124008 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:26:25.276005 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO dbcounter [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Registered counter for database nova_api Oct 04 10:26:25.277672 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO dbcounter [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Registered counter for database nova_api Oct 04 10:26:25.296049 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_db.sqlalchemy.engines [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.298523 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_db.sqlalchemy.engines [None req-41236215-77a7-4683-b869-d49b316c2354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.302787 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writer thread running {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.305082 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writer thread running {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.362206 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.context [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79d10631-ae89-4124-98da-b4c2efdbdef3(cell1) {{(pid=106091) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:26:25.364062 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.context [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79d10631-ae89-4124-98da-b4c2efdbdef3(cell1) {{(pid=106090) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:26:25.366137 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:26:25.366619 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:26:25.367837 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_concurrency.lockutils [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:26:25.368178 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:26:25.368309 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_concurrency.lockutils [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:26:25.368933 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:26:25.369385 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:26:25.369903 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_concurrency.lockutils [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:26:25.370628 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_concurrency.lockutils [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:26:25.371077 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_concurrency.lockutils [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:26:25.371376 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:26:25.373115 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_concurrency.lockutils [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:26:25.373406 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO dbcounter [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Registered counter for database nova_cell0 Oct 04 10:26:25.375101 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO dbcounter [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Registered counter for database nova_cell0 Oct 04 10:26:25.378007 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO dbcounter [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Registered counter for database nova_cell1 Oct 04 10:26:25.380160 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO dbcounter [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Registered counter for database nova_cell1 Oct 04 10:26:25.385225 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_db.sqlalchemy.engines [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.387416 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_db.sqlalchemy.engines [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.390311 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_db.sqlalchemy.engines [None req-41236215-77a7-4683-b869-d49b316c2354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.390706 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_db.sqlalchemy.engines [None req-41236215-77a7-4683-b869-d49b316c2354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.394757 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writer thread running {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.395094 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writer thread running {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.397790 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writer thread running {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.400027 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writer thread running {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.538335 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO dbcounter [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Registered counter for database nova_cell0 Oct 04 10:26:25.544333 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO dbcounter [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Registered counter for database nova_cell0 Oct 04 10:26:25.545000 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_db.sqlalchemy.engines [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.550547 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writer thread running {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.553854 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG oslo_db.sqlalchemy.engines [None req-41236215-77a7-4683-b869-d49b316c2354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:26:25.558538 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writer thread running {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:26:25.997926 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: WARNING keystonemiddleware.auth_token [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:26:26.006165 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: WARNING keystonemiddleware.auth_token [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:26:26.044332 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: WARNING keystonemiddleware.auth_token [None req-41236215-77a7-4683-b869-d49b316c2354 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:26:26.051956 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: WARNING keystonemiddleware.auth_token [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:26:26.371711 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: WARNING keystonemiddleware.auth_token [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:26:26.378740 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: WARNING keystonemiddleware.auth_token [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:26:26.384279 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565ba6b49c0 pid: 106091 (default app) Oct 04 10:26:26.386385 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:26:26.387567 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Oct 04 10:26:26.387969 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Tue Oct 4 10:26:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:26:26.426656 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: WARNING keystonemiddleware.auth_token [None req-41236215-77a7-4683-b869-d49b316c2354 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:26:26.432710 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: WARNING keystonemiddleware.auth_token [None req-41236215-77a7-4683-b869-d49b316c2354 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:26:26.438616 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565ba6b49c0 pid: 106090 (default app) Oct 04 10:27:52.132234 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:27:52.134252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002437 Oct 04 10:27:52.137228 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:27:52.156385 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_api:SELECT=3 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:52.157893 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_cell0:SELECT=3 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:52.159286 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_cell1:SELECT=3 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:52.160722 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:53.048788 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-1e6b4686-e227-4da7-a04e-f8f772008a7e admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:27:53.080295 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-1e6b4686-e227-4da7-a04e-f8f772008a7e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.936798 Oct 04 10:27:53.081408 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 10:27:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:27:55.694792 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:27:55.695847 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-666c279f-a1cf-4e82-9181-546e241ba42c None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 04 10:27:55.696209 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:27:56.160647 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-6c4daa35-79c8-4ee7-83da-e6f56a806e77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:27:56.262433 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-6c4daa35-79c8-4ee7-83da-e6f56a806e77 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.559464 Oct 04 10:27:56.262994 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:27:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:27:56.277454 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_api:SELECT=3 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:56.277454 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_cell1:SELECT=3 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:56.279295 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_cell0:SELECT=3 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:56.280220 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:56.488613 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-3547f301-989a-4d88-a108-e0f4849f7ab5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:27:56.610997 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-3547f301-989a-4d88-a108-e0f4849f7ab5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339630 Oct 04 10:27:56.611788 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 10:27:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:27:59.273986 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-6c4daa35-79c8-4ee7-83da-e6f56a806e77 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:27:59.275003 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-6c4daa35-79c8-4ee7-83da-e6f56a806e77 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 04 10:27:59.275394 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:27:59.932653 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-0cc7ea84-05d5-4ba2-b2fc-7e36d9e68931 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:00.113671 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-0cc7ea84-05d5-4ba2-b2fc-7e36d9e68931 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.831409 Oct 04 10:28:00.114355 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:27:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:28:00.127176 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-91027b75-160e-48fb-9549-732c313cbe8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:00.228036 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-91027b75-160e-48fb-9549-732c313cbe8a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105347 Oct 04 10:28:00.228730 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 10:28:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:02.887306 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-0cc7ea84-05d5-4ba2-b2fc-7e36d9e68931 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:02.888964 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-0cc7ea84-05d5-4ba2-b2fc-7e36d9e68931 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 04 10:28:02.889437 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:03.302872 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-68178197-07cf-46f8-a1aa-6e598ede1b68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "swap": 0, "vcpus": 1, "id": "d2", "ram": 1024}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:03.363494 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-68178197-07cf-46f8-a1aa-6e598ede1b68 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467877 Oct 04 10:28:03.364060 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:03.376666 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-09047729-5379-4e57-82d0-ce0377b2248e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:03.483002 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-09047729-5379-4e57-82d0-ce0377b2248e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110477 Oct 04 10:28:03.483931 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 10:28:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:06.170265 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-68178197-07cf-46f8-a1aa-6e598ede1b68 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:06.171203 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-68178197-07cf-46f8-a1aa-6e598ede1b68 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002254 Oct 04 10:28:06.171604 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:28:06.638998 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-6798f378-7520-4a72-9f47-4864c9d08850 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "disk": 10}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:06.781902 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-6798f378-7520-4a72-9f47-4864c9d08850 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.604150 Oct 04 10:28:06.782656 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:06.795182 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-a91273fb-17cd-4962-8b40-10592e7b01cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:06.898550 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-a91273fb-17cd-4962-8b40-10592e7b01cd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107509 Oct 04 10:28:06.899851 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 10:28:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:09.539010 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-6798f378-7520-4a72-9f47-4864c9d08850 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:09.540458 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-6798f378-7520-4a72-9f47-4864c9d08850 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Oct 04 10:28:09.540955 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:09.976019 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-607a5aef-264f-4b91-8786-d525baa1b8fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "ram": 4096, "vcpus": 4}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:10.052699 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-607a5aef-264f-4b91-8786-d525baa1b8fa admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505355 Oct 04 10:28:10.053284 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:10.066448 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-a04f9365-a2df-4967-baf5-719c7500e586 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:10.149034 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-a04f9365-a2df-4967-baf5-719c7500e586 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085723 Oct 04 10:28:10.150272 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 10:28:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:28:13.282021 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-607a5aef-264f-4b91-8786-d525baa1b8fa admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:13.283125 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-607a5aef-264f-4b91-8786-d525baa1b8fa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Oct 04 10:28:13.283544 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:13.733150 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-6794cdf9-68e7-423e-b3d1-f09955c43590 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:13.764373 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-6794cdf9-68e7-423e-b3d1-f09955c43590 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.474146 Oct 04 10:28:13.765163 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 10:28:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:16.460100 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-607a5aef-264f-4b91-8786-d525baa1b8fa admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:16.461080 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-607a5aef-264f-4b91-8786-d525baa1b8fa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 04 10:28:16.461482 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:16.904040 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-e7ff186f-0458-4a23-9177-a9a900ebfb66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:16.962742 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-e7ff186f-0458-4a23-9177-a9a900ebfb66 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.494445 Oct 04 10:28:16.963465 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:16.975871 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d831ee53-1339-4434-b507-4cdb5aa27d9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:17.046291 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d831ee53-1339-4434-b507-4cdb5aa27d9e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074034 Oct 04 10:28:17.046771 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 10:28:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:19.694142 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-e7ff186f-0458-4a23-9177-a9a900ebfb66 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:19.695131 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-e7ff186f-0458-4a23-9177-a9a900ebfb66 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 04 10:28:19.695699 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:20.082579 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-bc7d8da5-c6ef-494e-aac7-9c5fe3a22f95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:20.162852 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-bc7d8da5-c6ef-494e-aac7-9c5fe3a22f95 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460103 Oct 04 10:28:20.163412 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:28:20.176112 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-344042f9-038d-4d55-9cba-88d5f326fa2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:20.270126 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-344042f9-038d-4d55-9cba-88d5f326fa2a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097816 Oct 04 10:28:20.270702 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 10:28:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:22.941986 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-bc7d8da5-c6ef-494e-aac7-9c5fe3a22f95 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:22.943688 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-bc7d8da5-c6ef-494e-aac7-9c5fe3a22f95 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Oct 04 10:28:22.944372 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:23.390695 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-59191946-7a09-4675-993a-a52cdf0b3f4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "ram": 4096}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:23.477282 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-59191946-7a09-4675-993a-a52cdf0b3f4c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.525961 Oct 04 10:28:23.478024 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:28:23.494497 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-10f62b34-4676-4452-9b29-bbd239b729a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:23.501108 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:23.599401 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-10f62b34-4676-4452-9b29-bbd239b729a8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108530 Oct 04 10:28:23.600399 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 10:28:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:26.250662 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-59191946-7a09-4675-993a-a52cdf0b3f4c admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:26.251912 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-59191946-7a09-4675-993a-a52cdf0b3f4c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001778 Oct 04 10:28:26.252309 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:26.702329 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-77ed303b-4ab2-4c99-bc11-d6c0feeec599 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "name": "m1.large", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:26.780519 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-77ed303b-4ab2-4c99-bc11-d6c0feeec599 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.521794 Oct 04 10:28:26.784902 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:26.795884 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-0f684c2d-aa11-43bb-961b-266b17d4afaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:26.800959 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:26.904977 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-0f684c2d-aa11-43bb-961b-266b17d4afaf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113200 Oct 04 10:28:26.905509 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 10:28:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:29.572463 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-77ed303b-4ab2-4c99-bc11-d6c0feeec599 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:29.573523 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-77ed303b-4ab2-4c99-bc11-d6c0feeec599 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 04 10:28:29.574072 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:30.038389 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-5bd82640-f702-4961-9c64-50adee2d83ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:30.128024 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-5bd82640-f702-4961-9c64-50adee2d83ac admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.547035 Oct 04 10:28:30.141607 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-f017366c-877b-4ef0-bb6d-3aa8577f6764 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:30.147483 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 10:28:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:30.221591 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-f017366c-877b-4ef0-bb6d-3aa8577f6764 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084359 Oct 04 10:28:30.222174 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 10:28:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:28:47.868835 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-5bd82640-f702-4961-9c64-50adee2d83ac admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:47.870956 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-5bd82640-f702-4961-9c64-50adee2d83ac admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 04 10:28:47.871353 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:47.882114 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:48.264257 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-0eb79eb1-609f-486e-adf9-7f2a2438d27d admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:48.282677 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-0eb79eb1-609f-486e-adf9-7f2a2438d27d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405030 Oct 04 10:28:48.283205 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 10:28:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:49.809519 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-5bd82640-f702-4961-9c64-50adee2d83ac admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:49.810554 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-5bd82640-f702-4961-9c64-50adee2d83ac admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002325 Oct 04 10:28:49.810948 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:50.341945 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-9378a4f8-2f10-4bf1-8c59-15c8040254a2 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:50.347222 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.wsgi [None req-9378a4f8-2f10-4bf1-8c59-15c8040254a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-9378a4f8-2f10-4bf1-8c59-15c8040254a2 admin admin] Request method failure captured: Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Accept: application/json Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Accept-Encoding: gzip, deflate Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Connection: keep-alive Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Content-Length: 0 Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Host: 10.222.0.42 Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Openstack-Api-Version: compute 2.92 Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Openstack-System-Scope: None Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: User-Agent: python-novaclient Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Auth-Token: gAAAAABjPArhf1j1KMrbHvd157nUNNgXQCsYtw7OFgnQIKUXyPPZpVsKcc4NuPWaEshcDMf6vKOXpsA623HIjbFjilbRCDFHvgXGvZCl-qKeUS8NfYYbS_xZQC1saMBUVLptjS9q5s5HVY196ypiVEew2lexKf84szr_G5FxvbCG2gCiD04Hgtg Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Domain-Id: None Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Domain-Name: None Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Identity-Status: Confirmed Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Is-Admin-Project: True Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Domain-Id: default Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Domain-Name: Default Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Name: admin Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Role: reader,admin,member Oct 04 10:28:50.350475 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Roles: reader,admin,member Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76254fdd7dd646c69803abc10a472bc5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant: admin Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant-Name: admin Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User: admin Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Domain-Id: default Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Domain-Name: Default Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Id: 105ad03a7a5c40c78500f0ee01583fae Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Name: admin Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: method: > Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: exception: Flavor 42 could not be found. Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: action_args: {'id': '42'} Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:28:50.352186 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:50.353282 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.354742 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-9378a4f8-2f10-4bf1-8c59-15c8040254a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:28:50.356593 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-9378a4f8-2f10-4bf1-8c59-15c8040254a2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389337 Oct 04 10:28:50.356593 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 10:28:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:50.363029 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-f5e1cbab-0736-4810-b4ec-b1ae5a4a5a05 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:50.367064 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:50.385966 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-f5e1cbab-0736-4810-b4ec-b1ae5a4a5a05 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026568 Oct 04 10:28:50.387212 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 10:28:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:50.397695 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-587e53b4-e1c6-4497-a36f-f9e97cf1079f admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:50.419715 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-587e53b4-e1c6-4497-a36f-f9e97cf1079f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026499 Oct 04 10:28:50.420240 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 10:28:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:50.429809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-13bce18e-cec0-415e-a555-2c3b60966938 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:50.435391 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.wsgi [None req-13bce18e-cec0-415e-a555-2c3b60966938 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-13bce18e-cec0-415e-a555-2c3b60966938 admin admin] Request method failure captured: Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Accept: application/json Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Accept-Encoding: gzip, deflate Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Connection: keep-alive Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Content-Length: 0 Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Host: 10.222.0.42 Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Openstack-Api-Version: compute 2.92 Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Openstack-System-Scope: None Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: User-Agent: python-novaclient Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Auth-Token: gAAAAABjPArhf1j1KMrbHvd157nUNNgXQCsYtw7OFgnQIKUXyPPZpVsKcc4NuPWaEshcDMf6vKOXpsA623HIjbFjilbRCDFHvgXGvZCl-qKeUS8NfYYbS_xZQC1saMBUVLptjS9q5s5HVY196ypiVEew2lexKf84szr_G5FxvbCG2gCiD04Hgtg Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Domain-Id: None Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Domain-Name: None Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Identity-Status: Confirmed Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Is-Admin-Project: True Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Domain-Id: default Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Domain-Name: Default Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Name: admin Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Role: reader,admin,member Oct 04 10:28:50.438639 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Roles: reader,admin,member Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76254fdd7dd646c69803abc10a472bc5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant: admin Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant-Name: admin Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User: admin Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Domain-Id: default Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Domain-Name: Default Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Id: 105ad03a7a5c40c78500f0ee01583fae Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Name: admin Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: method: > Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: exception: Flavor 42 could not be found. Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: action_args: {'id': '42'} Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:28:50.450164 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:50.451155 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:50.452259 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-13bce18e-cec0-415e-a555-2c3b60966938 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:28:50.453411 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-13bce18e-cec0-415e-a555-2c3b60966938 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014109 Oct 04 10:28:50.453411 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 10:28:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 10:28:51.671286 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-587e53b4-e1c6-4497-a36f-f9e97cf1079f admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:51.673096 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-587e53b4-e1c6-4497-a36f-f9e97cf1079f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 04 10:28:51.673096 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:52.204737 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-734c6906-eaff-4922-8978-eeb078b25949 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:52.209756 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.wsgi [None req-734c6906-eaff-4922-8978-eeb078b25949 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-734c6906-eaff-4922-8978-eeb078b25949 admin admin] Request method failure captured: Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Accept: application/json Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Accept-Encoding: gzip, deflate Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Connection: keep-alive Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Content-Length: 0 Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Host: 10.222.0.42 Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Openstack-Api-Version: compute 2.92 Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Openstack-System-Scope: None Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: User-Agent: python-novaclient Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Auth-Token: gAAAAABjPArjATUfZGT6gxJcO5JekBKK8GocK9UoyEEjUxoAatcHFA93dgp4moVOXcxcwtEKH_KUvowFOR6GODD_TbVImhwuba2NvntUouIx6IZjv3luQVJYKeVU80XMU-dZv1hBJS7TOfHbRcMI-t7XuyzFarboxefbqBTkxcivTQPPXMSRS0w Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Domain-Id: None Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Domain-Name: None Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Identity-Status: Confirmed Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Is-Admin-Project: True Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Domain-Id: default Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Domain-Name: Default Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Name: admin Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Role: reader,admin,member Oct 04 10:28:52.211252 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Roles: reader,admin,member Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76254fdd7dd646c69803abc10a472bc5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant: admin Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant-Name: admin Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User: admin Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Domain-Id: default Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Domain-Name: Default Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Id: 105ad03a7a5c40c78500f0ee01583fae Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Name: admin Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: method: > Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: exception: Flavor 84 could not be found. Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: action_args: {'id': '84'} Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:28:52.212809 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:52.213670 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.215056 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-734c6906-eaff-4922-8978-eeb078b25949 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:28:52.216172 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-734c6906-eaff-4922-8978-eeb078b25949 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394889 Oct 04 10:28:52.216172 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 10:28:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:52.223087 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-e7f43fb5-34ba-4fe1-b0a7-633a3ded83c2 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:52.237843 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-e7f43fb5-34ba-4fe1-b0a7-633a3ded83c2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018305 Oct 04 10:28:52.238361 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 10:28:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:52.248130 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-af40e903-3445-4e0d-8d6f-73ee9ecbf0f6 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:52.264068 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-af40e903-3445-4e0d-8d6f-73ee9ecbf0f6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019949 Oct 04 10:28:52.264588 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 10:28:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:52.273797 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-13e7cd4f-6dff-4973-89bc-8fb65dce3672 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:52.278920 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.wsgi [None req-13e7cd4f-6dff-4973-89bc-8fb65dce3672 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-13e7cd4f-6dff-4973-89bc-8fb65dce3672 admin admin] Request method failure captured: Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Accept: application/json Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Accept-Encoding: gzip, deflate Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Connection: keep-alive Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Content-Length: 0 Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Host: 10.222.0.42 Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Openstack-Api-Version: compute 2.92 Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Openstack-System-Scope: None Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: User-Agent: python-novaclient Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Auth-Token: gAAAAABjPArjATUfZGT6gxJcO5JekBKK8GocK9UoyEEjUxoAatcHFA93dgp4moVOXcxcwtEKH_KUvowFOR6GODD_TbVImhwuba2NvntUouIx6IZjv3luQVJYKeVU80XMU-dZv1hBJS7TOfHbRcMI-t7XuyzFarboxefbqBTkxcivTQPPXMSRS0w Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Domain-Id: None Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Domain-Name: None Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Identity-Status: Confirmed Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Is-Admin-Project: True Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Domain-Id: default Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Domain-Name: Default Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Name: admin Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Role: reader,admin,member Oct 04 10:28:52.280445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Roles: reader,admin,member Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76254fdd7dd646c69803abc10a472bc5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant: admin Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant-Name: admin Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User: admin Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Domain-Id: default Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Domain-Name: Default Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Id: 105ad03a7a5c40c78500f0ee01583fae Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Name: admin Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: method: > Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: exception: Flavor 84 could not be found. Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: action_args: {'id': '84'} Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:28:52.282179 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:52.283121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:52.284480 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-13e7cd4f-6dff-4973-89bc-8fb65dce3672 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:28:52.285754 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-13e7cd4f-6dff-4973-89bc-8fb65dce3672 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011598 Oct 04 10:28:52.285754 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 10:28:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 10:28:53.531588 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-af40e903-3445-4e0d-8d6f-73ee9ecbf0f6 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:53.532583 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-af40e903-3445-4e0d-8d6f-73ee9ecbf0f6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 04 10:28:53.533035 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:54.071121 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-5122f9d3-873f-41d4-9744-a7919bcd7e17 admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:54.076947 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.wsgi [None req-5122f9d3-873f-41d4-9744-a7919bcd7e17 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-5122f9d3-873f-41d4-9744-a7919bcd7e17 admin admin] Request method failure captured: Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Accept: application/json Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Accept-Encoding: gzip, deflate Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Connection: keep-alive Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Content-Length: 0 Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Host: 10.222.0.42 Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Openstack-Api-Version: compute 2.92 Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Openstack-System-Scope: None Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: User-Agent: python-novaclient Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Auth-Token: gAAAAABjPArl1_pDkF5-j-bkIYXMz4gKTrQlLprDN3UUUi1-uIELmKghKWxqLA9Nl1RZc1uwmjICYMrItTwSJ9_ZHtei5Jn_wBwd_bcGzIZsZxW_vGGKBxbU-ODDAxdYxsDOGS4yk7a4xnmMXBQ_UhfNWcNMcuAgsukbgKUudOXw1BhaIZrFvCM Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Domain-Id: None Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Domain-Name: None Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Identity-Status: Confirmed Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Is-Admin-Project: True Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Domain-Id: default Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Domain-Name: Default Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Project-Name: admin Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Role: reader,admin,member Oct 04 10:28:54.078437 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Roles: reader,admin,member Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76254fdd7dd646c69803abc10a472bc5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant: admin Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-Tenant-Name: admin Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User: admin Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Domain-Id: default Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Domain-Name: Default Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Id: 105ad03a7a5c40c78500f0ee01583fae Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: X-User-Name: admin Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: method: > Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: exception: Flavor 451 could not be found. Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: action_args: {'id': '451'} Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:28:54.080360 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:54.081398 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.082757 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-5122f9d3-873f-41d4-9744-a7919bcd7e17 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:28:54.084124 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-5122f9d3-873f-41d4-9744-a7919bcd7e17 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.409828 Oct 04 10:28:54.084124 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 10:28:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:54.090237 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-8b8121bc-9db4-4da3-8d44-7849cd3b8f92 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:54.104780 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-8b8121bc-9db4-4da3-8d44-7849cd3b8f92 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018547 Oct 04 10:28:54.106354 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 10:28:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:54.115547 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:54.131375 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019374 Oct 04 10:28:54.131905 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 10:28:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:28:54.141381 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-7919050a-82bc-42d7-aa34-1487d7b5e85c admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:54.146288 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.wsgi [None req-7919050a-82bc-42d7-aa34-1487d7b5e85c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-7919050a-82bc-42d7-aa34-1487d7b5e85c admin admin] Request method failure captured: Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Accept: application/json Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Accept-Encoding: gzip, deflate Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Connection: keep-alive Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Content-Length: 0 Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Host: 10.222.0.42 Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Openstack-Api-Version: compute 2.92 Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Openstack-System-Scope: None Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: User-Agent: python-novaclient Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Auth-Token: gAAAAABjPArl1_pDkF5-j-bkIYXMz4gKTrQlLprDN3UUUi1-uIELmKghKWxqLA9Nl1RZc1uwmjICYMrItTwSJ9_ZHtei5Jn_wBwd_bcGzIZsZxW_vGGKBxbU-ODDAxdYxsDOGS4yk7a4xnmMXBQ_UhfNWcNMcuAgsukbgKUudOXw1BhaIZrFvCM Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Domain-Id: None Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Domain-Name: None Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Identity-Status: Confirmed Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Is-Admin-Project: True Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Domain-Id: default Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Domain-Name: Default Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Project-Name: admin Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Role: reader,admin,member Oct 04 10:28:54.147789 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Roles: reader,admin,member Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76254fdd7dd646c69803abc10a472bc5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76254fdd7dd646c69803abc10a472bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant: admin Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant-Id: 76254fdd7dd646c69803abc10a472bc5 Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-Tenant-Name: admin Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User: admin Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Domain-Id: default Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Domain-Name: Default Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Id: 105ad03a7a5c40c78500f0ee01583fae Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: X-User-Name: admin Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: method: > Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: exception: Flavor 451 could not be found. Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: action_args: {'id': '451'} Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:28:54.149493 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:54.150475 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: ERROR nova.api.openstack.wsgi Oct 04 10:28:54.151750 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-7919050a-82bc-42d7-aa34-1487d7b5e85c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:28:54.153729 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-7919050a-82bc-42d7-aa34-1487d7b5e85c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011285 Oct 04 10:28:54.153729 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 10:28:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:55.366354 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:55.367369 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 04 10:28:55.367764 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:55.886044 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-9dc7893e-9e07-4ae1-871b-2c68c49a6873 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:55.990572 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-9dc7893e-9e07-4ae1-871b-2c68c49a6873 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.485624 Oct 04 10:28:55.991124 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 10:28:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:57.237444 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:57.238445 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 04 10:28:57.238852 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:57.767210 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-b54226d1-42e4-4d9a-9ec4-bf44abd67efa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:57.835841 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-b54226d1-42e4-4d9a-9ec4-bf44abd67efa admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.461417 Oct 04 10:28:57.836381 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 10:28:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:28:59.164462 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:28:59.165607 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 04 10:28:59.166014 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:28:59.690989 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-b65edad5-1f2e-45cb-a55b-6e5c8dfcf066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:28:59.797378 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-b65edad5-1f2e-45cb-a55b-6e5c8dfcf066 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.490544 Oct 04 10:28:59.797922 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 10:28:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:29:01.017992 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:29:01.019006 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 04 10:29:01.019394 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:29:01.552422 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-dcdd9bd6-b19b-4ac5-b5ed-c6a9245cad88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:29:01.669915 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-dcdd9bd6-b19b-4ac5-b5ed-c6a9245cad88 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.510024 Oct 04 10:29:01.670473 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 10:29:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:29:02.920682 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:29:02.921713 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 04 10:29:02.922100 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:29:03.447040 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-cea87f1d-9452-41af-b212-f127ecf0c3ab admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:29:03.470851 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-cea87f1d-9452-41af-b212-f127ecf0c3ab admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.412019 Oct 04 10:29:03.470851 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Tue Oct 4 10:29:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:30:00.628461 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:30:00.629500 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-d9978468-d918-44ac-a6d9-dd25ea52150b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 04 10:30:00.629887 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 10:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:30:00.640257 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:30:01.019005 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-b8c00a26-e457-4996-ab61-3caf21cfebae admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:30:01.040003 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-b8c00a26-e457-4996-ab61-3caf21cfebae admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404281 Oct 04 10:30:01.040531 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 10:30:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:30:01.062117 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_api:SELECT=14 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:30:01.065897 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-5e371543-e0fe-4aca-9990-08f0d5e9ecda admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:30:01.073832 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-5e371543-e0fe-4aca-9990-08f0d5e9ecda admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012392 Oct 04 10:30:01.074463 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Tue Oct 4 10:30:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:30:01.086082 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-aeda4700-6b69-40e1-a3eb-9901c1425951 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:30:01.093367 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-aeda4700-6b69-40e1-a3eb-9901c1425951 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010800 Oct 04 10:30:01.093867 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Tue Oct 4 10:30:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:30:01.105325 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:30:01.112633 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011164 Oct 04 10:30:01.113174 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Tue Oct 4 10:30:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:30:01.125130 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-3c9f00a3-30cd-4a7a-aec7-34ae2b326255 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:30:01.132223 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-3c9f00a3-30cd-4a7a-aec7-34ae2b326255 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010854 Oct 04 10:30:01.132728 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Tue Oct 4 10:30:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:33:08.307528 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:08.308588 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 04 10:33:08.309270 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:33:08.450416 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_api:SELECT=6 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:33:08.606798 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:08.611622 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:08.612104 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:08.612536 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:08.613314 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:08.613759 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:08.614633 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:08.647404 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-15fb550d-3749-47f9-bf4f-e0a223df59b4 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198786 Oct 04 10:33:08.647958 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 10:33:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:33:09.762721 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:09.763785 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Oct 04 10:33:09.764183 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:33:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:33:09.956010 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:09.959652 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:09.960122 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:09.960547 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:09.961313 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:09.961758 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:09.962171 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:09.981451 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-18b81614-aa9f-4ac4-aae3-6d06cf32f4eb admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076365 Oct 04 10:33:09.982009 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 10:33:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:33:21.499490 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:21.500595 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 04 10:33:21.506114 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:33:21.652562 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_cell0:SELECT=4 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:33:21.653317 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_cell1:SELECT=4 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:33:21.653926 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG dbcounter [-] [106091] Writing DB stats nova_api:SELECT=8 {{(pid=106091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:33:21.702489 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:21.705972 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:21.706457 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:21.707165 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:21.707873 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:21.708311 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:21.708724 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:21.733922 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-c7ed81e0-cf95-473a-9054-5a13d0037aec admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085813 Oct 04 10:33:21.734545 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 10:33:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:33:22.809564 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG nova.api.openstack.wsgi [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] Calling method '>' {{(pid=106090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:22.810604 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: INFO nova.api.openstack.requestlog [None req-2f323b78-76b2-4101-9621-b18a5a101b6f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 04 10:33:22.811086 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: [pid: 106090|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 10:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:33:23.001081 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG nova.api.openstack.wsgi [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] Calling method '>' {{(pid=106091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:33:23.004447 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:23.004942 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:23.005374 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:23.006083 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:33:23.006531 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:33:23.006948 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: DEBUG oslo_concurrency.lockutils [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:33:23.028586 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: INFO nova.api.openstack.requestlog [None req-a1b9e877-6a77-40a9-a7d7-f465c8c28f95 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080003 Oct 04 10:33:23.029160 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: [pid: 106091|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 10:33:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:34:18.928211 dv-cinder-859193-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 10:34:18.928915 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: Tue Oct 4 10:34:18 2022 - graceful shutdown triggered... Oct 04 10:34:18.929370 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: Gracefully killing worker 1 (pid: 106090)... Oct 04 10:34:18.930043 dv-cinder-859193-3-iscsi devstack@n-api.service[106091]: Gracefully killing worker 2 (pid: 106091)... Oct 04 10:34:19.055300 dv-cinder-859193-3-iscsi devstack@n-api.service[106090]: DEBUG dbcounter [-] [106090] Writing DB stats nova_api:SELECT=4 {{(pid=106090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:19.928973 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: worker 1 buried after 1 seconds Oct 04 10:34:19.929454 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: worker 2 buried after 1 seconds Oct 04 10:34:19.929454 dv-cinder-859193-3-iscsi devstack@n-api.service[106089]: goodbye to uWSGI. Oct 04 10:34:19.930566 dv-cinder-859193-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 04 10:34:19.931109 dv-cinder-859193-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 10:34:19.933850 dv-cinder-859193-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 10:34:19.944391 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 10:34:19 2022] *** Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: nodename: dv-cinder-859193-3-iscsi Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: machine: x86_64 Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: clock source: unix Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: pcre jit disabled Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: detected number of CPU cores: 4 Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: current working directory: / Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: detected binary path: /usr/bin/uwsgi-core Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: your processes number limit is 47680 Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: your memory page size is 4096 bytes Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: detected max file descriptor number: 2048 Oct 04 10:34:19.946398 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: lock engine: pthread robust mutexes Oct 04 10:34:19.947438 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: thunder lock: enabled Oct 04 10:34:19.947438 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 10:34:19.947438 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 10:34:19.986864 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: Python main interpreter initialized at 0x55b330e6e9c0 Oct 04 10:34:19.986864 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: python threads support enabled Oct 04 10:34:19.986864 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: your server socket listen backlog is limited to 100 connections Oct 04 10:34:19.986864 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: your mercy for graceful operations on workers is 90 seconds Oct 04 10:34:19.987301 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 10:34:19.987301 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: *** Operational MODE: preforking *** Oct 04 10:34:19.987546 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: *** uWSGI is running in multiple interpreter mode *** Oct 04 10:34:19.987546 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: spawned uWSGI master process (pid: 127616) Oct 04 10:34:19.987748 dv-cinder-859193-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 10:34:19.988351 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: spawned uWSGI worker 1 (pid: 127627, cores: 1) Oct 04 10:34:19.988911 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: spawned uWSGI worker 2 (pid: 127628, cores: 1) Oct 04 10:34:19.989242 dv-cinder-859193-3-iscsi devstack@n-api.service[127616]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 10:34:20.661487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:34:20.663771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:34:21.829371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:34:21.829371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: from cryptography.utils import int_from_bytes Oct 04 10:34:21.830155 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:34:21.830155 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: from cryptography.utils import int_from_bytes Oct 04 10:34:21.839972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:34:21.839972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: from cryptography.utils import int_from_bytes Oct 04 10:34:21.840478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:34:21.840478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: from cryptography.utils import int_from_bytes Oct 04 10:34:24.323397 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:34:24.324109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:34:24.324207 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:34:24.324580 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:34:24.324844 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:34:24.325276 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.325609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.325938 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.326267 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.326608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.326928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.327256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.327583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.327918 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.328184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.328506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.329831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-3-iscsi {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.330255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.330588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.330916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.331256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.331572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.331906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.332478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.333042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.335023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.335023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.335023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.335023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.335337 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.335411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.335919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.336051 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.336349 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.336668 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.337116 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-3-iscsi {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.337447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.337772 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.338094 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.338543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.338857 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.339163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.339489 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.339816 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.340138 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.340478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.340798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.341156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.341491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.341812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.342111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.342427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.342763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.343078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.343388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.343657 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.343960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.344950 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.345484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.345919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.346096 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.346343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.346678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.347004 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.347324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.347640 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.347955 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.348277 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.348529 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:34:24.349000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.349100 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:34:24.349184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.349184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.349451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:34:24.349531 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.349735 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:34:24.349836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.350233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:34:24.350358 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.350465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.350560 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.350729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.350833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.351054 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.351155 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.351376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.351469 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.351709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.351814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.352023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.352115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.352349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.352449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.352678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.352783 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.353021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.353132 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.353289 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.353383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.353611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.353712 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.353967 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.354088 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-3-iscsi {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.354284 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.354423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.354600 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.354743 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.354912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.355068 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.355256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.355400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.355572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.355711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.355828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.356041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.356143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.356363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.356465 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.356744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.356898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.357084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.357218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.357398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.357535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.357710 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.357854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.358015 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.358199 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.358329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.358523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.358659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.358849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.358958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.359176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.359277 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.359494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.359599 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.359851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.359960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.360171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.360299 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.360479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.360576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-3-iscsi {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.360829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.360969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.361169 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.361264 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.361496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.361597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.361825 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.362033 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.362131 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.362279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.362437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.362594 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.362755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.362923 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.363069 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.363254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.363396 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.363573 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.363709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.363909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.364020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.364237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.364329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.364563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.364655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.364909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.365019 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.365224 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.365324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.365539 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.365639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.365858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.365963 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.366186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.366302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.366494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.366586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.366801 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.366906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.367058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.367155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.367372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.367463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.367706 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.367806 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368015 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368328 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368421 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368842 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.368970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.369188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.369289 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.369513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.369607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.369828 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.369919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.370142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.370243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.370455 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.370555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.370766 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.370858 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.371077 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.371169 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.371386 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.371489 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.371699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.371805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.372010 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.372119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.372334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.372429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.372654 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.372848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.373054 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.373225 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.373366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.373481 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.373629 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.373758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.374004 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.374148 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.374273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.374393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.374591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.374718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.374936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.375065 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.375253 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.375373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.375601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.375730 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.375998 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.376141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.376263 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.376385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.376555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.376698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.376913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.377049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.377245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.377381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.377571 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.378968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.379084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.379183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.379270 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.379364 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.379455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.379555 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.379648 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.379741 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.379827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.379918 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.380010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.380104 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.380198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.380292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.380377 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.380470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.380564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.380658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.380745 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.380837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.381191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.381508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.381825 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.382004 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.382138 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.382347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.382441 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.382688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.382782 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.383020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.383114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.383347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.383447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.383662 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.383817 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.383977 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.384080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.384303 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.384403 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.384625 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.384730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.384960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.385135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.385293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.385440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.385590 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.385755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.385920 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.386079 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.386237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.386403 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.386504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.386728 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.386820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.387074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.387177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.387400 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.387493 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.387728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.387826 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.388049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.388141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.388360 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.388464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.388674 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.388774 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.389023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.389117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.389331 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.389425 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.389642 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.389745 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.389952 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.390057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.390266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.390370 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.390577 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.390676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.390888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.390988 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.391812 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.391957 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.392161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.392364 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.392502 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.392607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.392799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.392927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.393176 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.393273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.393484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.393595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.393805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.393905 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.394128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.394220 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.394442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.394533 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.394752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.394851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.395064 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.395163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.395383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.395475 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:34:24.395695 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.395788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.396028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.396131 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.396349 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.396443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.396663 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.396763 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.397020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.397117 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.397337 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.397433 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.397649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.397796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.397971 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.398074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.398292 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.398396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.398609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.398702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.398926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.399035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.399245 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.399336 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.399568 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.399667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.399883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.399985 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.400201 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.400293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.400534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.400631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.400874 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.400981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.401199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.401290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.401524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.401616 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.401846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.401946 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.402165 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.402305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.402475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.402619 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.402799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.403072 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.403173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.403260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.403408 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.403501 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.403719 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.403824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.404037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.404131 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.404346 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.404446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.404657 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.404752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.405001 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.405109 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.405314 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.405422 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.405625 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.405720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.405957 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.406050 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.406279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.406386 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.406590 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.406759 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.407799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.407905 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.407994 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.408095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.408182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.408335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.408428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.408514 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.408734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.408839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.409077 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.409175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.409398 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.409500 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.409720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.409815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.410062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.410171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.410385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.410479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.410705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.410806 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.411025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.411121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.411343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.411443 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.411678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.411814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.412111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.412219 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.412317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.412454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.412602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.412696 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.412937 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.413035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.413252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.413354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.413568 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.413669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.413891 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.413988 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.414200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.414306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.414526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.414622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.414859 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.414951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.415176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.415284 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.415513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.415606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.415824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.415916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.416147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.416255 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.416468 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.416597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.416782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.416969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.417119 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.417223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.417436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.417535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.417754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.417859 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.418064 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.418157 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.418383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.418482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.418707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.418801 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.419017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.419109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.419344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.419479 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.419654 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.419746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.419966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.420068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.420273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.420367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.420594 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.420702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.420945 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.421044 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.421266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.443851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444042 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444751 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.444954 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445425 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445574 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445720 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.445986 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446267 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446694 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446783 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446876 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.446964 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447254 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447430 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.447988 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448208 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448589 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448723 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448822 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.448961 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449139 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449308 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449397 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449498 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449593 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449680 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449816 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.449908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450001 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450098 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450287 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450382 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450900 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.450991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451085 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451533 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451723 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451818 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451905 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.451999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452179 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452274 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452612 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452804 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.452930 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.453031 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.453171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.453270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.453359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.453470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.454170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.454457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.454839 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.454994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.455138 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.455282 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.455424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.455564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.455705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.455837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.455977 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.456128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.456261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.456400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.456540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.456681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.456822 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.456989 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.457126 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.457519 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.457742 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.457879 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458154 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458429 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458575 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458709 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458849 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.458990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.459158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.459306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.459459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.459609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.459750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.459884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.460023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.460168 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.460316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.460449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.460590 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.460723 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.460878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.461029 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.461164 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.461308 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.461453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.461596 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.461736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.461883 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462119 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.462847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463018 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.463924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464011 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464097 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464268 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464410 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464725 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464819 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.464925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465118 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465756 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.465939 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466480 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.466937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467033 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467829 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.467977 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468210 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468210 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468515 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468701 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468794 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.468936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.469039 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.469139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.469861 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.470451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.470572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.470672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.470762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.470848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.470945 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471364 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471651 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471737 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.471918 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472069 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472768 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.472980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473063 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473448 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.473939 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474032 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474235 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474323 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474907 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.474996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475207 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475298 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.475948 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476034 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476120 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476220 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476412 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476790 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.476958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477229 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.477916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478217 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478697 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478697 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478870 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.478964 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479599 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479871 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.479956 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480207 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480298 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.480942 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481042 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481652 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481836 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.481932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482207 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482744 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.482896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483038 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483538 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483735 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.483917 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484011 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484438 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484531 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.484833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.485522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.485637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.485737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.485827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.485914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486015 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486202 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486289 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486559 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.486920 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487007 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487106 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487379 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487640 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.487986 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488187 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.488846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489151 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489286 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489490 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489586 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489768 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.489944 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490138 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490411 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490694 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490783 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.490972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491069 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491252 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491348 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491677 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491863 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.491949 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492237 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.492912 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493043 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493171 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493267 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493392 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493470 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493552 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493806 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.493999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494096 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494310 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494500 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494596 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494679 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.494921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495118 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495389 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495482 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495570 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.495939 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496026 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496801 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.496934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497126 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497221 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497323 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497719 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.497901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.498023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.498129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.498343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.498446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.498667 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.498778 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.498985 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.499090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.499302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.499400 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.499620 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.499729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.499932 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.500028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.500241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.500335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.500588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501108 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501108 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501596 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.501951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.502171 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.502281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.502484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.502579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.502802 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.502908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.503111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.503248 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.503437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.503554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.503750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.503882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.504062 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.504180 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.504375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.504493 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.504727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.504830 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510022 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510179 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510370 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510662 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.510923 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511201 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511287 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511373 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511565 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511902 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.511997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512439 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.512926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513118 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513248 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513377 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513856 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.513930 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514011 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514094 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514242 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514242 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.514907 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515236 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515809 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.515907 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.516003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517562 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517661 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517750 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.517949 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518124 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518692 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.518968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519163 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519252 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519802 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.519966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.520129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.520279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.520456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.520601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.520783 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.520943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.521127 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.521262 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.521460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.521601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.521784 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.521913 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.522109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.522216 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.522432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.522541 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.522755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.522852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.523099 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.523204 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.523427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.523583 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.523753 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.523866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.524065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.524215 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.524397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.524493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.524716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.524821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.525066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.525246 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.525388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.525486 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.525698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.525806 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.526030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.526134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.526351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.526455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.526666 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.526770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.526978 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.527080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.527291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.527387 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.527604 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.527700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.527921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.528023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.528241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.528344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.528558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.528655 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.528907 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.529007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.529217 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.529323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.529535 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.529633 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.529855 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.529987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.530189 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.530303 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.530520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.530617 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.530848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.530942 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.531168 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.531272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.531488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.531583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.532030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.532442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.532442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.532628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.532730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.532819 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.532936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.533081 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.533189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.533418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.533514 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.533750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.533846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.534074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.534237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.534386 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.534489 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.534719 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.534860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.535030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.535134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.535339 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.535444 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.535659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.535764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.535972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.536085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.536280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.536382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.536589 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.536683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.536940 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.537040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.537254 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.537361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.537584 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.537708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.537904 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.538038 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.538239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.538446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.538553 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.538803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.538909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.539128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.539224 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.539463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.539566 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.539796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.540030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.540458 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.540556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.540556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.540727 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.540727 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.540920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.541062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.541168 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.541375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.541476 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.541700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.541803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.542018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.542255 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.542350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.542599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.542705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.542931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.543027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.543247 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.543349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.543559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.543667 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.543882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.543989 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.544192 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.544286 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.544516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.544613 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.544827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.544995 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.545176 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.545272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.545491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.545591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.545810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.545915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.546122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.546218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.546443 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.546541 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.546746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.546842 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.547058 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.547167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.547980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.548550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.548681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.548808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.548972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549360 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.549976 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.550093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.550208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.550387 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.550524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.550720 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.550824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.551035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.551144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.551348 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.551454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.551673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.551778 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.551996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.552099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.552326 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.552437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.552641 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.552736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.552979 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.553090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.553316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.553412 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.553658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.553754 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.553989 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.554206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.554312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.554559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.554673 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.554871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.554967 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.555209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.555447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.555551 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.555776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.555870 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.556119 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.556215 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.556448 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.556543 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.556781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.556898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.557127 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.557237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.557452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.557557 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.557775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.557872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.558088 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.558196 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.558402 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.558539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.558720 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.558815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.559035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.559143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.559352 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.559446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.559674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.559771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.559990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.560092 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.560302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.560405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.560619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.560721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.560959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.561060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.561281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.561506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.561603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.561860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.561969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.562184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.562317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.562520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.562651 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.562853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.563051 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.563252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.563395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.563564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.563674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.563945 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.564056 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.564200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.564296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.564510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.564655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.564831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.564986 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.565175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.565315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.565489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.565628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.565801 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.565899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.566122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.566225 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.566442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.566548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.566754 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.566856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.567076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.567171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.567387 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.567491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.567722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.567817 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.568037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.568139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.568352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.568456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.568667 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.568770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.569010 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.569109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.569335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.569449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.569651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.569754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.569966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.570061 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.570280 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.570377 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.570599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.570703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.570911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.571008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.571227 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.571323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.571547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.571643 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.571871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.571965 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.572188 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.572292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.572498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.572601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.572807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.572993 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.573156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.573254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.573523 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.573636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.573785 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.573896 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.574095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.574194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.574405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.574503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.574725 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.574899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.575031 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.575139 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.575340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.575443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.575650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.575756 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.575959 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.576080 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.576269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.576534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.576639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.576912 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.577012 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.577207 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.577308 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.577517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.577623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.577828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.577924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.578137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.578244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.578445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.579096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.579593 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.579692 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.579692 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.579871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.579995 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.580105 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.580319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.580415 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.580643 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.580737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.580992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.581103 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.581315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.581419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.581635 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.581739 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.581956 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.582052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.582592 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.582701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.582912 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.583006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.583234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.583330 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.583556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.583650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.583873 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.583997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.584190 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.584302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.584509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.584606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.584828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.584973 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.585174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.585280 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.585509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.585700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.585854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.586141 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.586250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.586473 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.586680 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.586797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.587126 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.587235 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.587452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.587648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.587752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.588088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.588198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.588407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.588606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.588709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.589072 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.589170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.589394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.589600 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.589695 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.590018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.590112 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.590335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.590595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.590699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.590956 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.591077 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.591282 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.591617 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.591737 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.591951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.592267 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.592364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.592598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.592807 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.592958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.593315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.593408 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.593635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.593806 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.593990 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.594926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.595394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.595491 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.595627 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.595777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.595919 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.596080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.596327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.596424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:34:24.596821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.597370 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.597902 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.598420 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.598933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.599412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.599899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.600381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.600913 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.601399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.601889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.602367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.602844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.603335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.603814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.604288 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.604761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.605289 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.605776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.606250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.606724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.607199 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.607669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.608146 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.608842 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.609139 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.609617 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.610522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.610675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.611067 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.611542 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.612145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.614379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.614379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.614379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.615463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.615463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.615708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.616216 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.618687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.618687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.618687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.618687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.618687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.619451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.619451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.619750 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.619990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.620316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.620666 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.621035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.621354 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.621695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.622024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.622357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.622685 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.623008 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.623349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.623671 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.623992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.624317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.624640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.624983 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.625311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.625780 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.626159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.626480 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.626814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.627152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.627488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.627929 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.628539 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.628987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.629409 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.629927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.630489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.630856 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.631281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.631612 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.632127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:34:24.632584 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:34:24.661556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Registered counter for database nova_api Oct 04 10:34:24.682333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.689757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:24.696714 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO dbcounter [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Registered counter for database nova_api Oct 04 10:34:24.717974 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_db.sqlalchemy.engines [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.725343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writer thread running {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:24.747453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.context [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79d10631-ae89-4124-98da-b4c2efdbdef3(cell1) {{(pid=127627) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:34:24.752028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:34:24.752506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:34:24.754115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:34:24.754863 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:34:24.755314 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:34:24.757340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:34:24.759335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Registered counter for database nova_cell0 Oct 04 10:34:24.763380 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Registered counter for database nova_cell1 Oct 04 10:34:24.772392 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.774673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.779294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:24.783633 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.context [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79d10631-ae89-4124-98da-b4c2efdbdef3(cell1) {{(pid=127628) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:34:24.788504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:34:24.789100 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:34:24.791623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:34:24.792774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:34:24.793267 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:34:24.795374 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:34:24.798106 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO dbcounter [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Registered counter for database nova_cell0 Oct 04 10:34:24.802562 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO dbcounter [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Registered counter for database nova_cell1 Oct 04 10:34:24.810853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_db.sqlalchemy.engines [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.812391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_db.sqlalchemy.engines [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.820510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writer thread running {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:24.821058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writer thread running {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:24.924345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:24.934600 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO dbcounter [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Registered counter for database nova_cell0 Oct 04 10:34:24.941427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.946161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writer thread running {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:24.971384 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO dbcounter [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Registered counter for database nova_cell0 Oct 04 10:34:24.978287 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_db.sqlalchemy.engines [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:34:24.982901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writer thread running {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:34:25.268845 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:34:25.276226 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:34:25.307160 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: WARNING keystonemiddleware.auth_token [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:34:25.314722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: WARNING keystonemiddleware.auth_token [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:34:25.623203 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:34:25.629857 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: WARNING keystonemiddleware.auth_token [None req-0a9f8ec4-c678-447a-b272-72b5c80fe47e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:34:25.635168 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b330e6e9c0 pid: 127627 (default app) Oct 04 10:34:25.669947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: WARNING keystonemiddleware.auth_token [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:34:25.680332 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: WARNING keystonemiddleware.auth_token [None req-d773ab0d-559f-454e-8cf2-96ecb9b4952e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:34:25.689283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b330e6e9c0 pid: 127628 (default app) Oct 04 10:35:03.474516 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:03.475726 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:03.476897 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:03.478013 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:03.634846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:03.635856 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:03.637078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:03.638403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:04.444261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-256862cb-836f-4da4-8e72-c870cd1dff0a tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Action: 'create', calling method: .version_select at 0x7f9bea410550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1844062537"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:04.758368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-88a31241-3112-4e59-aac3-3f8a022746ce tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Action: 'create', calling method: .version_select at 0x7f9bea416550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2117004630", "metadata": {"Type": "work"}}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:06.566952 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-256862cb-836f-4da4-8e72-c870cd1dff0a tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.092788 Oct 04 10:35:06.566952 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Oct 4 10:35:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3096 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 04 10:35:06.576790 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7b797b27-c10b-416b-b568-47a78fb10c9c tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2df430>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:06.672338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-88a31241-3112-4e59-aac3-3f8a022746ce tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.045272 Oct 04 10:35:06.673277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 10:35:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3048 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 04 10:35:06.689152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bb9ed224-6951-4abe-b526-70afd0ed6be1 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Calling method '.version_select at 0x7f9bea2e73a0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:06.764365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7b797b27-c10b-416b-b568-47a78fb10c9c tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 200 len: 345 microversion: 2.1 time: 0.193554 Oct 04 10:35:06.765833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:06 2022] GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:35:06.839681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bb9ed224-6951-4abe-b526-70afd0ed6be1 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418" status: 200 len: 353 microversion: 2.1 time: 0.155772 Oct 04 10:35:06.847542 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:06 2022] GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:35:07.784853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-22d9d2ad-6992-4a79-a695-704f20f21970 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2dfaf0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:07.857737 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-55a927f0-f73d-472d-921d-b9a8ad098039 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Calling method '.version_select at 0x7f9bea2e7a60>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:07.925501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-22d9d2ad-6992-4a79-a695-704f20f21970 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 200 len: 345 microversion: 2.1 time: 0.149423 Oct 04 10:35:07.930780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:07 2022] GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:07.974066 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-55a927f0-f73d-472d-921d-b9a8ad098039 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418" status: 200 len: 353 microversion: 2.1 time: 0.121730 Oct 04 10:35:07.975123 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:07 2022] GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:08.946057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b76800d2-31d8-4c3c-bcd6-043089a37d22 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea27f1f0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:08.991490 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b3a0eb22-cffa-4030-b22a-32d893a2812c tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Calling method '.version_select at 0x7f9bea27f160>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:09.131778 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b3a0eb22-cffa-4030-b22a-32d893a2812c tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418" status: 200 len: 354 microversion: 2.1 time: 0.146674 Oct 04 10:35:09.132357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:08 2022] GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:09.146352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ff023da5-d7fe-4868-8ce0-a833daabfb0b tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Calling method '.version_select at 0x7f9bea2e7dc0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:09.222262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b76800d2-31d8-4c3c-bcd6-043089a37d22 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 200 len: 346 microversion: 2.1 time: 0.281248 Oct 04 10:35:09.223046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:08 2022] GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:09.237411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cbf4f0fd-e9ee-4b3c-ab21-e17d3e7d2137 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Action: 'create', calling method: .version_select at 0x7f9bea2dfdc0>, body: {"snapshot": {"volume_id": "a0461ae7-3f00-4c6a-ad8f-d0adfe57084a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-294442572"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:09.260192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ff023da5-d7fe-4868-8ce0-a833daabfb0b tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418" status: 200 len: 354 microversion: 2.1 time: 0.118146 Oct 04 10:35:09.261023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:09 2022] GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:35:09.291391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-12eec2a2-6734-44eb-a34d-bc794787063e tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Calling method '.version_select at 0x7f9bea2e7700>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:09.644043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-12eec2a2-6734-44eb-a34d-bc794787063e tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418" status: 202 len: 0 microversion: 2.1 time: 0.359552 Oct 04 10:35:09.644994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:35:09 2022] DELETE /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:35:09.662798 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3a4d36b8-0d31-4981-bca5-d56a4286da82 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Calling method '.version_select at 0x7f9bea27f280>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:09.777032 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3a4d36b8-0d31-4981-bca5-d56a4286da82 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418" status: 200 len: 353 microversion: 2.1 time: 0.128252 Oct 04 10:35:09.778083 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 7/11] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:09 2022] GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:10.063929 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cbf4f0fd-e9ee-4b3c-ab21-e17d3e7d2137 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.830281 Oct 04 10:35:10.069108 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 5/12] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 4 10:35:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:10.081719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1c209b24-f53c-4ac7-8e4f-6fb85a12ed9b tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2e7550>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:10.247924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1c209b24-f53c-4ac7-8e4f-6fb85a12ed9b tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 200 len: 286 microversion: 2.1 time: 0.170419 Oct 04 10:35:10.249416 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:10 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:10.265465 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5ffc46f8-1d9c-4a38-92fa-8f10cdd2c86a tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea27f700>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:10.402090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5ffc46f8-1d9c-4a38-92fa-8f10cdd2c86a tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.144755 Oct 04 10:35:10.402879 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 6/14] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Oct 4 10:35:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:10.416940 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-951da592-4694-4e07-9a43-64a9909c5cb5 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2e7ca0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:10.514529 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-951da592-4694-4e07-9a43-64a9909c5cb5 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 200 len: 286 microversion: 2.1 time: 0.102926 Oct 04 10:35:10.515773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 9/15] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:10 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:10.792323 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f7313a3e-fffd-43a3-a3e6-8a07ef4fded7 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Calling method '.version_select at 0x7f9bea2df3a0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:10.845168 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-f7313a3e-fffd-43a3-a3e6-8a07ef4fded7 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] HTTP exception thrown: Volume 093b0fea-7806-4c16-9836-be92a4c30418 could not be found. Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f7313a3e-fffd-43a3-a3e6-8a07ef4fded7 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Request method failure captured: Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 HTTP/1.1 Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxXE-dGDsZM4E1aJ4hAbTsLAmyyGFzSlzfbyEuze7qDaMVXJj3nv8z-4Im9GkxUzBPT7pZMWbR8qAzsNxGDYy8N2fyCw1XTGb4b5HwnPZrOdOq_JJeR98PFD3eOOnwTSeeZv0o6Ln8-RU_EePHM_MoNrLrI5NTw7iqaYSa_HF-FQKs Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 5544cf09578142d18e2812964499a59a Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesGetTestJSON-2097358140 Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:35:10.850255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5544cf09578142d18e2812964499a59a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5544cf09578142d18e2812964499a59a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5544cf09578142d18e2812964499a59a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5544cf09578142d18e2812964499a59a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesGetTestJSON-2097358140 Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 5544cf09578142d18e2812964499a59a Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesGetTestJSON-2097358140 Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesGetTestJSON-2097358140-project Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 58c512b71af84c32b365e23b7d05ba3b Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesGetTestJSON-2097358140-project Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Volume 093b0fea-7806-4c16-9836-be92a4c30418 could not be found. Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '093b0fea-7806-4c16-9836-be92a4c30418'} Oct 04 10:35:10.851374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 093b0fea-7806-4c16-9836-be92a4c30418 could not be found. (HTTP 404) (Request-ID: req-75a2e0dc-2395-477e-8b8d-52e67802becd) Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:10.852033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:10.853716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 093b0fea-7806-4c16-9836-be92a4c30418 could not be found. Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 10:35:10.854676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 093b0fea-7806-4c16-9836-be92a4c30418 could not be found. Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 093b0fea-7806-4c16-9836-be92a4c30418 could not be found. Oct 04 10:35:10.855594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:10.858892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f7313a3e-fffd-43a3-a3e6-8a07ef4fded7 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] Returning 404 to user: Volume 093b0fea-7806-4c16-9836-be92a4c30418 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:35:10.859969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f7313a3e-fffd-43a3-a3e6-8a07ef4fded7 tempest-VolumesGetTestJSON-2097358140 tempest-VolumesGetTestJSON-2097358140-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418" status: 404 len: 109 microversion: 2.1 time: 0.071723 Oct 04 10:35:10.862511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 7/16] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:10 2022] GET /compute/v2.1/os-volumes/093b0fea-7806-4c16-9836-be92a4c30418 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:35:11.532917 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2aa694f4-e89e-4cb8-bfd3-13a7eff81286 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea27f700>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:11.682478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2aa694f4-e89e-4cb8-bfd3-13a7eff81286 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 200 len: 286 microversion: 2.1 time: 0.156771 Oct 04 10:35:11.683568 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:11 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:12.697303 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d5f980b9-74fd-4019-83a2-3039a6f7ccb7 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9beac3db80>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:12.778572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d5f980b9-74fd-4019-83a2-3039a6f7ccb7 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 200 len: 286 microversion: 2.1 time: 0.086177 Oct 04 10:35:12.785332 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 8/18] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:12 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:13.798035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-83c934bc-867b-4a0a-bfdc-76fc04d630b0 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2e7dc0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:13.878370 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-83c934bc-867b-4a0a-bfdc-76fc04d630b0 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 200 len: 286 microversion: 2.1 time: 0.090555 Oct 04 10:35:13.878951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:13 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:14.892410 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9da10858-bfc3-4c2c-aaa9-b5b8ada2fe65 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2df280>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:14.950122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9da10858-bfc3-4c2c-aaa9-b5b8ada2fe65 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 200 len: 287 microversion: 2.1 time: 0.062089 Oct 04 10:35:14.950678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 9/20] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:14 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:14.963503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-770ab890-4f76-47e7-9c0e-cc18b6500f39 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2e78b0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:15.148125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-770ab890-4f76-47e7-9c0e-cc18b6500f39 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 202 len: 0 microversion: 2.1 time: 0.188781 Oct 04 10:35:15.149137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 12/21] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Oct 4 10:35:14 2022] DELETE /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:35:15.158359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ce5fc4a0-ed69-472e-a0d4-e4df4a8eddcd tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea265430>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:15.227343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ce5fc4a0-ed69-472e-a0d4-e4df4a8eddcd tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 200 len: 286 microversion: 2.1 time: 0.074105 Oct 04 10:35:15.228476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 10/22] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:15 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:16.241580 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9cb388f2-5fcd-4ab7-9c37-e7cc153f5ba7 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea27f4c0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:16.292684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-9cb388f2-5fcd-4ab7-9c37-e7cc153f5ba7 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] HTTP exception thrown: Snapshot 9a311128-8348-4ce5-9d7f-db2e5debc9ea could not be found. Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9cb388f2-5fcd-4ab7-9c37-e7cc153f5ba7 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Request method failure captured: Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea HTTP/1.1 Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxXh_y0ql5n35CBjIxNj6qca-JbP0ZxekM8Zer-Wdo-0VHQt9DmAMSzCzQy_n8U1m31EWJbm51Hv6Qltox4b_ve0IEnpZX7UPVV3xyLVpuDGXbWY9EyOZcM6qouY20cRoCVm_lrXhUpqSv-RL43PE6gcJvGZmxb6O2K6K6VdheXgZA Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:35:16.293656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_432c7036f0c94938be4572e3bbfc118d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 2f9a9372a0f2477b9e0833cd50609d7b Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Snapshot 9a311128-8348-4ce5-9d7f-db2e5debc9ea could not be found. Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '9a311128-8348-4ce5-9d7f-db2e5debc9ea'} Oct 04 10:35:16.294684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9a311128-8348-4ce5-9d7f-db2e5debc9ea could not be found. (HTTP 404) (Request-ID: req-e05f6546-fc9e-4b77-9379-9dcf29a1647e) Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:16.295933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:16.296787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9a311128-8348-4ce5-9d7f-db2e5debc9ea could not be found. Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 10:35:16.298345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9a311128-8348-4ce5-9d7f-db2e5debc9ea could not be found. Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9a311128-8348-4ce5-9d7f-db2e5debc9ea could not be found. Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9cb388f2-5fcd-4ab7-9c37-e7cc153f5ba7 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Returning 404 to user: Snapshot 9a311128-8348-4ce5-9d7f-db2e5debc9ea could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9cb388f2-5fcd-4ab7-9c37-e7cc153f5ba7 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea" status: 404 len: 111 microversion: 2.1 time: 0.057549 Oct 04 10:35:16.299936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 13/23] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 10:35:16 2022] GET /compute/v2.1/os-snapshots/9a311128-8348-4ce5-9d7f-db2e5debc9ea => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:35:16.304592 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-23b58d34-3676-4ea1-84f7-2a6f956a5d96 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea265af0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:16.627947 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-23b58d34-3676-4ea1-84f7-2a6f956a5d96 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 202 len: 0 microversion: 2.1 time: 0.327044 Oct 04 10:35:16.628989 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:35:16 2022] DELETE /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:35:16.639059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0d5ff395-3a3d-48bf-9ef6-d46246f33493 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea27fca0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:16.763032 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0d5ff395-3a3d-48bf-9ef6-d46246f33493 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 200 len: 345 microversion: 2.1 time: 0.128626 Oct 04 10:35:16.763702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:16 2022] GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:16.939997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6bcb8ad9-c3ed-40b8-b224-54b2614267eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: .version_select at 0x7f9bea26b1f0>, body: {"keypair": {"name": "tempest-keypair-948902764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnpDZojd737tEp8MaJOYashB1GNkjJVCC+JghzotUfQorSb3bdFrsHxt25clMhPHJDQU48hTsTSmRk9bZrZx4MlHaVhZZ0CejBVQpd6Wa0Q7cZTF+vbyPX8uSpuIZ9Btw=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:17.053279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-6bcb8ad9-c3ed-40b8-b224-54b2614267eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:17.068704 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-6bcb8ad9-c3ed-40b8-b224-54b2614267eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:17.303365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6bcb8ad9-c3ed-40b8-b224-54b2614267eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.590127 Oct 04 10:35:17.312575 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 12/26] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:35:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:35:17.777863 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b1aa7385-968e-49b3-9a89-ad057fa43db1 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea262430>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:17.836234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-b1aa7385-968e-49b3-9a89-ad057fa43db1 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] HTTP exception thrown: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b1aa7385-968e-49b3-9a89-ad057fa43db1 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Request method failure captured: Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a HTTP/1.1 Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxXh_y0ql5n35CBjIxNj6qca-JbP0ZxekM8Zer-Wdo-0VHQt9DmAMSzCzQy_n8U1m31EWJbm51Hv6Qltox4b_ve0IEnpZX7UPVV3xyLVpuDGXbWY9EyOZcM6qouY20cRoCVm_lrXhUpqSv-RL43PE6gcJvGZmxb6O2K6K6VdheXgZA Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:35:17.840223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_432c7036f0c94938be4572e3bbfc118d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 2f9a9372a0f2477b9e0833cd50609d7b Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'a0461ae7-3f00-4c6a-ad8f-d0adfe57084a'} Oct 04 10:35:17.841947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. (HTTP 404) (Request-ID: req-d8f947e0-c327-4f3e-9326-fe6706669dbb) Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:17.842788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:17.843676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 10:35:17.844628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.845534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.851162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b1aa7385-968e-49b3-9a89-ad057fa43db1 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Returning 404 to user: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:35:17.852338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b1aa7385-968e-49b3-9a89-ad057fa43db1 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 404 len: 109 microversion: 2.1 time: 0.078965 Oct 04 10:35:17.853170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:17 2022] GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:35:17.870712 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c558f5c0-e2df-45d4-adc5-8f6f185dd912 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea1c95e0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:17.950090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-c558f5c0-e2df-45d4-adc5-8f6f185dd912 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] HTTP exception thrown: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c558f5c0-e2df-45d4-adc5-8f6f185dd912 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Request method failure captured: Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a HTTP/1.1 Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxXh_y0ql5n35CBjIxNj6qca-JbP0ZxekM8Zer-Wdo-0VHQt9DmAMSzCzQy_n8U1m31EWJbm51Hv6Qltox4b_ve0IEnpZX7UPVV3xyLVpuDGXbWY9EyOZcM6qouY20cRoCVm_lrXhUpqSv-RL43PE6gcJvGZmxb6O2K6K6VdheXgZA Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:35:17.953528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_432c7036f0c94938be4572e3bbfc118d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 2f9a9372a0f2477b9e0833cd50609d7b Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'a0461ae7-3f00-4c6a-ad8f-d0adfe57084a'} Oct 04 10:35:17.954738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. (HTTP 404) (Request-ID: req-40d2f87d-2509-4d67-8197-8586c8479c1c) Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:17.955375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 10:35:17.956275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 10:35:17.958073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c558f5c0-e2df-45d4-adc5-8f6f185dd912 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Returning 404 to user: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c558f5c0-e2df-45d4-adc5-8f6f185dd912 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 404 len: 109 microversion: 2.1 time: 0.088823 Oct 04 10:35:17.960211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 13/28] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:35:17 2022] DELETE /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:35:17.965597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6a536ff2-ace3-4930-9910-a1f8810fe149 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Calling method '.version_select at 0x7f9bea2623a0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:18.038386 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-6a536ff2-ace3-4930-9910-a1f8810fe149 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] HTTP exception thrown: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6a536ff2-ace3-4930-9910-a1f8810fe149 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Request method failure captured: Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a HTTP/1.1 Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxXh_y0ql5n35CBjIxNj6qca-JbP0ZxekM8Zer-Wdo-0VHQt9DmAMSzCzQy_n8U1m31EWJbm51Hv6Qltox4b_ve0IEnpZX7UPVV3xyLVpuDGXbWY9EyOZcM6qouY20cRoCVm_lrXhUpqSv-RL43PE6gcJvGZmxb6O2K6K6VdheXgZA Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:35:18.040670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_432c7036f0c94938be4572e3bbfc118d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/432c7036f0c94938be4572e3bbfc118d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 432c7036f0c94938be4572e3bbfc118d Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-332937815 Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 2f9a9372a0f2477b9e0833cd50609d7b Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-332937815-project Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'a0461ae7-3f00-4c6a-ad8f-d0adfe57084a'} Oct 04 10:35:18.042019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. (HTTP 404) (Request-ID: req-cf097a72-0368-4fe7-b746-c921bdc5645e) Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:18.042799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:35:18.043924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 10:35:18.045073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6a536ff2-ace3-4930-9910-a1f8810fe149 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] Returning 404 to user: Volume a0461ae7-3f00-4c6a-ad8f-d0adfe57084a could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6a536ff2-ace3-4930-9910-a1f8810fe149 tempest-VolumesSnapshotsTestJSON-332937815 tempest-VolumesSnapshotsTestJSON-332937815-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a" status: 404 len: 109 microversion: 2.1 time: 0.081364 Oct 04 10:35:18.051997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:35:17 2022] GET /compute/v2.1/os-volumes/a0461ae7-3f00-4c6a-ad8f-d0adfe57084a => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:35:20.141535 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-81698192-f200-4330-b26f-cfd8034099f2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'create', calling method: .version_select at 0x7f9bea27f550>, body: {"keypair": {"name": "tempest-keypair-236201382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo7r3guyuUy+oU37Qh9MpGU7mPjWx+6YQB25TPMtFdpRNwZLodHJEk6NWNI2UZIYxO5youyC5zxB6xZ9szl3hxWEOZq3PvGHFEfsGeputLBpGO6TSJOPat3TIC9JaRIJg=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:20.178318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-81698192-f200-4330-b26f-cfd8034099f2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:20.185561 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-81698192-f200-4330-b26f-cfd8034099f2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for user 3008efcf02c644e3bc09850d6bd6eb63 and project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:20.376117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-81698192-f200-4330-b26f-cfd8034099f2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.490664 Oct 04 10:35:20.377588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 14/30] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:35:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:21.180024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1422485287", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "networks": [{"uuid": "0a078f4c-ed92-4f92-adfa-dfb2f896ee7e"}]}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:21.357389 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] validate_networks() for [('0a078f4c-ed92-4f92-adfa-dfb2f896ee7e', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:35:23.777901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:35:23.779206 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:35:23.780427 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:35:23.781179 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:35:23.781741 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:35:23.838851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:23.839844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:23.842191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:23.844317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:23.844777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:23.845606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:23.883247 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Getting quotas for project 2e7330488d40469199873490c5fd2bb4. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:23.891138 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Getting quotas for user 7b69eb143b5d42c3b4a8cb292c6a70d7 and project 2e7330488d40469199873490c5fd2bb4. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:23.906718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:35:23.909744 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:35:24.169256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-23228aa6-25a1-4dc9-bc4a-c49a81741507 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.437570 Oct 04 10:35:24.170817 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 17/31] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:35:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:35:24.196608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0c2d4c6b-072b-410e-ae36-3a1a8f9406e8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:24.201764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0c2d4c6b-072b-410e-ae36-3a1a8f9406e8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:24.432173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b76c3ef6-db2a-4254-8e04-e6eb0da6dead tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'create', calling method: .version_select at 0x7f9bea1ec820>, body: {"keypair": {"name": "tempest-keypair-1762534592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsfhSHqBTL1mNLijzrva/+/EcbFrhOGk5WjcHod6QW43prXa0b9uBC0TVQ3x73sq2Gf8KAYVwAZcr+rRw0WnpH61disBn/U6FJj9ylHWNNXPPB8z0taV46jKWbqFqyL9g=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:24.464698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0c2d4c6b-072b-410e-ae36-3a1a8f9406e8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:24.486761 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-b76c3ef6-db2a-4254-8e04-e6eb0da6dead tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for project 17e605186f7944a79d36288d99d1eaa9. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:24.499372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0c2d4c6b-072b-410e-ae36-3a1a8f9406e8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1215 microversion: 2.1 time: 0.318949 Oct 04 10:35:24.500347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-b76c3ef6-db2a-4254-8e04-e6eb0da6dead tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for user 3c7fcc99edab427aa2b750bf6b15b39c and project 17e605186f7944a79d36288d99d1eaa9. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:24.511144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 18/32] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:24 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:24.638601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b76c3ef6-db2a-4254-8e04-e6eb0da6dead tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.711686 Oct 04 10:35:24.639732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 15/33] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 10:35:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 713 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 10:35:24.762349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1337334048", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:24.864109 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] validate_networks() for [('63e2f114-1421-4ab0-8fd6-833187dffa8d', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:35:25.269717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1720168250", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1"}], "security_groups": [{"name": "tempest-securitygroup--1522211495"}], "key_name": "tempest-keypair-948902764", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:25.544503 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] validate_networks() for [('2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:35:26.506184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:35:26.506698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:35:26.507063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:35:26.507469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:35:26.518156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:35:26.549033 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:26.549510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:26.549958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:26.553167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:26.556678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:26.557177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:26.607025 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:26.621290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for user c4f4844eb5e14d789476cfb44e2516f0 and project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:26.641084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:35:26.644794 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:35:26.872683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-18eda7f7-54bd-4d6d-98a0-c3e19217ac0e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.357785 Oct 04 10:35:26.875908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 19/34] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:35:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:35:26.900291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-041a1866-51c4-40f8-9454-b5520efe8d83 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:26.903463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-041a1866-51c4-40f8-9454-b5520efe8d83 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:27.077142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-041a1866-51c4-40f8-9454-b5520efe8d83 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:27.090306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-041a1866-51c4-40f8-9454-b5520efe8d83 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1215 microversion: 2.1 time: 0.206453 Oct 04 10:35:27.110172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 20/35] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:26 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1215 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:27.115134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1712f726-a884-4cee-b70d-c2fdbf325f2a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:27.129960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1712f726-a884-4cee-b70d-c2fdbf325f2a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:27.340237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1712f726-a884-4cee-b70d-c2fdbf325f2a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:27.354651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1712f726-a884-4cee-b70d-c2fdbf325f2a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1222 microversion: 2.1 time: 0.243288 Oct 04 10:35:27.355470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 21/36] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:27 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:27.369520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1556046518", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9839a451-68ef-402c-a445-af1f7dc2e79f"}], "security_groups": [{"name": "tempest-securitygroup--1210503002"}], "key_name": "tempest-keypair-236201382", "user_data": "}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:27.714751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:35:27.715315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:35:27.715563 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:35:27.716171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:35:27.716620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:35:27.743292 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:27.743813 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:27.746635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:27.747456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:27.749655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:27.750442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:27.798782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:27.804135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:27.806891 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] validate_networks() for [('9839a451-68ef-402c-a445-af1f7dc2e79f', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:35:27.827349 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:35:27.831452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:35:28.143410 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dd9fd1cc-3cac-4e58-89af-0a52b5883ec3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.879121 Oct 04 10:35:28.146221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 16/37] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:35:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 10:35:28.154290 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-173761922", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:28.237701 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] validate_networks() for [('63e2f114-1421-4ab0-8fd6-833187dffa8d', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:35:29.106397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:35:29.107504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:35:29.108348 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:35:29.108981 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:35:29.109793 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:35:29.124699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:29.125233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:29.125679 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:29.126406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:29.126862 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:29.127289 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:29.270651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:29.276847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for user 3008efcf02c644e3bc09850d6bd6eb63 and project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:29.328109 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:35:29.339620 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:35:29.568808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:35:29.569808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:35:29.571656 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:35:29.572507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:35:29.573199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:35:29.585472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-26d591cd-e8e2-449d-805c-439c8645efe6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.228246 Oct 04 10:35:29.624975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 22/38] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:35:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:35:29.652101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:29.654759 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:29.657557 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:29.658118 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:29.661324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:29.664944 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:29.666472 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:29.667124 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:29.696710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:29.697896 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:29.702140 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:29.704073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:29.706231 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:29.707116 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:29.738386 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:29.752055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for user c4f4844eb5e14d789476cfb44e2516f0 and project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:29.788736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:35:29.792160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:35:29.954546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:29.971606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3216efc9-a634-4b9b-94b4-18f83f5b53eb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1267 microversion: 2.1 time: 0.347030 Oct 04 10:35:30.002731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:29 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:30.012614 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1b5a5187-2269-4fd0-87ef-5b82fd5b161e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:30.019149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1b5a5187-2269-4fd0-87ef-5b82fd5b161e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:30.064031 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-82ef322b-1068-4f55-9314-5bb96c04a818 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.913092 Oct 04 10:35:30.074850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 17/40] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:35:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:35:30.095899 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-044646f0-dfe8-4ab1-ad31-c54c07d9b026 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:30.098958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-044646f0-dfe8-4ab1-ad31-c54c07d9b026 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:30.163442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1b5a5187-2269-4fd0-87ef-5b82fd5b161e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:30.175900 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1b5a5187-2269-4fd0-87ef-5b82fd5b161e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1241 microversion: 2.1 time: 0.171804 Oct 04 10:35:30.176813 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 24/41] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:30 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1241 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:30.210955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d42f23a1-4891-459f-8856-49c11175a8c5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:30.211590 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d42f23a1-4891-459f-8856-49c11175a8c5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:30.378933 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-044646f0-dfe8-4ab1-ad31-c54c07d9b026 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:30.383365 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d42f23a1-4891-459f-8856-49c11175a8c5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:30.404839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d42f23a1-4891-459f-8856-49c11175a8c5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1221 microversion: 2.1 time: 0.226758 Oct 04 10:35:30.407301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 25/42] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:30 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:30.427558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-044646f0-dfe8-4ab1-ad31-c54c07d9b026 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1237 microversion: 2.1 time: 0.350727 Oct 04 10:35:30.430959 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 18/43] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:30 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1237 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:31.038184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:31.039449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:31.055114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:31.061581 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:31.064352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:31.065497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:31.067619 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:31.068071 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:31.206286 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:31.207056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:31.222122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:31.222598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:31.223050 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:31.224563 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:31.225067 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:31.228703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:31.453810 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:31.469196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e224d5ae-46f2-401c-b35f-9f7845a1ca34 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1285 microversion: 2.1 time: 0.438194 Oct 04 10:35:31.491231 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 26/44] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:31 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1285 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:31.505191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-903bf37d-cd86-4382-b69f-516269c114ef tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:31.515569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-903bf37d-cd86-4382-b69f-516269c114ef tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:31.600489 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:31.616928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c11391bd-580b-43db-aa02-bac7ef162c26 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1237 microversion: 2.1 time: 0.418648 Oct 04 10:35:31.624323 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 19/45] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:31 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1237 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:31.630854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:31.631479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:31.638821 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:31.639861 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:31.640644 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:31.641682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:31.642295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:31.642938 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:31.653704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-903bf37d-cd86-4382-b69f-516269c114ef tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:31.663225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-903bf37d-cd86-4382-b69f-516269c114ef tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1221 microversion: 2.1 time: 0.170799 Oct 04 10:35:31.663811 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 27/46] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:31 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1221 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:31.694200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1676358679", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3777809b-2b97-4e60-ad42-7e512a3a37c4"}], "security_groups": [{"name": "tempest-securitygroup--717952267"}], "key_name": "tempest-keypair-1762534592", "user_data": "}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:31.792268 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:31.815085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c2bde39f-dd5f-411f-b1c9-b8f5b8439713 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1241 microversion: 2.1 time: 0.189103 Oct 04 10:35:31.822682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 20/47] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:31 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:32.189244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] validate_networks() for [('3777809b-2b97-4e60-ad42-7e512a3a37c4', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:35:32.499198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:32.499996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:32.510294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:32.511130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:32.512483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:32.513390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:32.515121 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:32.516047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:32.661896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:32.671380 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-45edc297-0046-4933-8740-ea3c50819f03 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1273 microversion: 2.1 time: 0.175774 Oct 04 10:35:32.690275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:32 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:32.695924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:32.696807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:32.705666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:32.706328 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:32.706912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:32.710756 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:32.710756 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:32.710756 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:32.844198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:32.857374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a58c066e-fcb4-4514-a6f3-b16f9144279e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1293 microversion: 2.1 time: 0.165642 Oct 04 10:35:32.862436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 22/49] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:32 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1293 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:32.868016 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:32.871142 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:32.890285 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:32.902156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:32.902837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:32.903792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:32.905094 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:32.905718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.037384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:33.050280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-48bd143e-a0de-462b-a94f-ac7b27d7f8e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1217 microversion: 2.1 time: 0.186430 Oct 04 10:35:33.053752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 23/50] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:32 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:33.075677 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:33.077831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:33.087529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.088279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.089018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.091327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.093295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.097255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.231748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:35:33.232263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:35:33.236610 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:35:33.242668 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:35:33.242668 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:35:33.268269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:33.273381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.274286 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.274747 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.276182 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.276652 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.277130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.296057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-24e14c7b-c534-4560-a370-4d3ccdfdd9f9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1233 microversion: 2.1 time: 0.227950 Oct 04 10:35:33.296057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 24/51] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:33 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1233 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:33.316412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for project 17e605186f7944a79d36288d99d1eaa9. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:35:33.332418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for user 3c7fcc99edab427aa2b750bf6b15b39c and project 17e605186f7944a79d36288d99d1eaa9. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:35:33.352043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:35:33.354969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:35:33.612640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0b3b1fdf-a6af-42b3-93e2-efe53e970b57 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.945264 Oct 04 10:35:33.612640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 28/52] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 10:35:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 10:35:33.636204 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-72523db4-b6a3-4be2-995a-80eb184c7f3c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:33.643273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-72523db4-b6a3-4be2-995a-80eb184c7f3c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:33.697510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:33.699319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:33.706939 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-72523db4-b6a3-4be2-995a-80eb184c7f3c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:33.707182 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.707812 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.708815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.711491 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.712112 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.712692 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.715755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-72523db4-b6a3-4be2-995a-80eb184c7f3c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:33.717855 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-72523db4-b6a3-4be2-995a-80eb184c7f3c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:33.718981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-72523db4-b6a3-4be2-995a-80eb184c7f3c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1282 microversion: 2.20 time: 0.098026 Oct 04 10:35:33.726924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 25/53] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:33 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:33.885066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:33.886303 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:33.893644 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.894260 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.895792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.896788 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:33.897605 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:33.898236 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:33.928777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:33.938961 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-69d80b08-3935-4ae6-b58f-e799de16c521 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.244512 Oct 04 10:35:33.946514 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 29/54] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:33 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:33.981961 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:33.987837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8c046abe-25b4-41b6-9f27-5c956045e4e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1293 microversion: 2.1 time: 0.106673 Oct 04 10:35:33.988409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 26/55] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:33 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:34.078862 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:34.080202 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:34.084522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:34.094211 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:34.094704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:34.095192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:34.098475 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:34.098475 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:34.098475 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:34.167778 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:34.178188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ea5289e2-3513-45f7-b092-e657134cb301 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1217 microversion: 2.1 time: 0.103801 Oct 04 10:35:34.180338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 30/56] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:34 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:34.319490 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:34.320106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:34.326893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:34.327607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:34.328595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:34.329538 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:34.330242 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:34.330877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:34.400594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:34.412650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-faff4903-d83f-43c9-9c1f-2c1658b23989 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1233 microversion: 2.1 time: 0.093190 Oct 04 10:35:34.412650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 27/57] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:34 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:34.745499 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bb13057b-227d-45b2-91d1-b5d986720d3b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:34.746010 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bb13057b-227d-45b2-91d1-b5d986720d3b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:34.810626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bb13057b-227d-45b2-91d1-b5d986720d3b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:34.818611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bb13057b-227d-45b2-91d1-b5d986720d3b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:34.820094 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bb13057b-227d-45b2-91d1-b5d986720d3b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:34.821221 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bb13057b-227d-45b2-91d1-b5d986720d3b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1282 microversion: 2.20 time: 0.079821 Oct 04 10:35:34.828936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 31/58] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:34 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:34.964574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:34.966452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:34.979227 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:34.980744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:34.981516 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:34.984369 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:34.986056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:34.987493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.012488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:35.013318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:35.023990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.024745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.025456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.026808 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.028006 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.028786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.159314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:35.176187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c3d300ae-41e1-44d9-b26e-869f4ccd484a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1293 microversion: 2.1 time: 0.168387 Oct 04 10:35:35.180377 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 32/59] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:35 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1293 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:35.214345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:35.218465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:35.233589 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.234343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.234849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.235625 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.236221 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.236785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.423883 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:35.459187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a55a19b6-8365-468b-ae95-056eb5f209a1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1217 microversion: 2.1 time: 0.254548 Oct 04 10:35:35.460440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 33/60] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:35 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:35.477995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:35.484625 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:35.494613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:35.499842 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c1d4d83a-2dce-435e-818a-c0d7e84690cb tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.539816 Oct 04 10:35:35.503775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 28/61] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:34 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:35.508453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.508965 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.511463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.511463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.511463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.511463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.797753 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:35.814647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d5b651f9-6836-4a4f-8b98-ca5f9af6cac5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1233 microversion: 2.1 time: 0.351449 Oct 04 10:35:35.817144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 34/62] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:35 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1233 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:35.853893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:35.854608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:35.865939 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.869566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.870660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:35.873494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:35.874269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:35.877128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.127288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:36.148504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:36.155024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:36.165708 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6c19bde1-cc10-4d97-833c-f855d8581524 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1286 microversion: 2.20 time: 0.311788 Oct 04 10:35:36.171701 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 29/63] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:35 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1286 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:36.208836 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:36.209481 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:36.220529 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.221048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.221483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.222181 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.222662 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.223081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.378689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:36.393496 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-350f2f18-2a7c-46fe-b63f-6b0ff4f0d60a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1293 microversion: 2.1 time: 0.194310 Oct 04 10:35:36.394417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 35/64] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:36 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1293 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:36.491426 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:36.492322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:36.500152 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:36.501687 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.502396 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.503005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.503886 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.504488 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.505189 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.553000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:36.553000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:36.553000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.553000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.553266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.553266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.553266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.553266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.744492 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:36.754705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-46e87e79-9eba-42c5-92bc-734859019912 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1217 microversion: 2.1 time: 0.269003 Oct 04 10:35:36.765625 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 30/65] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:36 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1217 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:36.840687 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:36.842093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:36.849849 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.850653 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.851324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:36.852265 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:36.852962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:36.853610 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:37.020047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:37.035850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-93ecb032-2402-4b36-9376-bf1bd3ce6cc4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1233 microversion: 2.1 time: 0.195067 Oct 04 10:35:37.035850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 31/66] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:36 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1233 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:37.200329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:37.202083 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:37.231734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:37.233145 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:37.236431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:37.236431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:37.238398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:37.242041 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:37.381747 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:37.391389 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-972ae7c3-f4b0-486f-96e9-62a97190b523 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.867739 Oct 04 10:35:37.409057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 36/67] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:36 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:37.439265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:37.439265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:37.439265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:37.439265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:37.439647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:37.439647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:37.439647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:37.439647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:37.659732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:37.665686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:37.667543 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-22ec8f8b-286b-4c11-bb47-b5a34be8f231 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1301 microversion: 2.1 time: 0.245184 Oct 04 10:35:37.676882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 37/68] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:37 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1301 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:37.681143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:37.698452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:37.698452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f2fc2391-8883-4cf8-9025-7e55237a3ec9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1278 microversion: 2.20 time: 0.492661 Oct 04 10:35:37.698452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 32/69] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:37 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1278 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:35:37.792552 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:37.793314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:37.806470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:37.806672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:37.807083 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:37.813446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:37.814319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:37.815772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:38.059378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:38.060016 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:38.084669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:38.085183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:38.085636 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:38.086353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:38.086814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:38.087243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:38.303982 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:38.322142 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-13a64482-a2cc-45c9-b09d-8c5f937b4018 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1289 microversion: 2.1 time: 0.267776 Oct 04 10:35:38.322778 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 33/70] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:38 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1289 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:38.423251 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:38.423979 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:38.434738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:38.437354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:38.438785 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:38.438785 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:38.440879 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:38.441732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:38.443555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:38.450391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d9f2fce0-846b-46c1-afef-0c3d55c27375 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1217 microversion: 2.1 time: 0.662539 Oct 04 10:35:38.454745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 38/71] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:37 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1217 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:38.717420 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:38.718356 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:38.733381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:38.733950 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:38.734916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:38.738536 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:38.739243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:38.739722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:39.205580 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:39.218661 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a7d5bfd9-19d2-4347-9410-85355c920781 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1299 microversion: 2.1 time: 0.506453 Oct 04 10:35:39.223329 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 39/72] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:38 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1299 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:39.225452 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:39.226740 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:39.234955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:39.235683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:39.236270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:39.237196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:39.237822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:39.238397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:39.244224 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:39.257914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-15a277f4-403c-4d8e-844f-41ca31f86cb8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.837285 Oct 04 10:35:39.269887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 34/73] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:38 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:39.350232 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:39.351200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:39.359440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:39.359995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:39.360440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:39.361420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:39.366917 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:39.373526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:39.446950 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:39.466309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:39.473533 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:39.474892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d37686fd-5892-4037-bde3-e112c8089537 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1278 microversion: 2.20 time: 0.253784 Oct 04 10:35:39.477995 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 40/74] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:39 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:39.485182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:39.488469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:39.489841 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:39.490800 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:39.500128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-43821bce-7ce3-4e8b-b159-4c99831a0e53 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1295 microversion: 2.1 time: 0.155390 Oct 04 10:35:39.500750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 35/75] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:39 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1295 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:39.503855 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:39.504505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:39.505135 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:39.505999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:39.506592 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:39.507325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:39.648143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:39.663665 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7c825927-e5e0-425a-b239-8bf36d0aa6b0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1273 microversion: 2.1 time: 0.182992 Oct 04 10:35:39.664284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 41/76] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:39 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:40.254930 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:40.256057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:40.278602 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=4 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:40.286314 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:40.291453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:40.291453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:40.291637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:40.291738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:40.291843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:40.291971 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:40.301461 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:40.305244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:40.305847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:40.306320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:40.307154 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:40.307811 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:40.308445 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:41.114783 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:41.130380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-784d9921-2949-4f02-97e0-f2fc2edd2ccc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.844591 Oct 04 10:35:41.134228 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 42/77] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:40 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:41.149076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:41.150334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:41.155532 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:41.165245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-aee65bb8-0110-4702-945a-07ef0de7e871 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.922677 Oct 04 10:35:41.178720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:41.179521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:41.179841 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 36/78] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:40 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:41.180479 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:41.184504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:41.189147 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:41.189147 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:41.198975 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:41.201758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:41.208821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:41.223190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:41.225499 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:41.228102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:41.229135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:41.230934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:41.232704 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:41.454073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:41.468743 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:41.479540 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:41.480585 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-738c09a8-8176-4722-a216-37d2fd0a9aee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1334 microversion: 2.20 time: 0.345128 Oct 04 10:35:41.484015 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 43/79] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:41 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1334 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:41.488765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:41.489446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:41.516264 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:41.519719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:41.519719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:41.519719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:41.519719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:41.520175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:41.828380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:41.859397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c6992080-da37-4553-83fa-9b079c39bdd9 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1279 microversion: 2.1 time: 0.374203 Oct 04 10:35:41.868893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 44/80] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:41 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1279 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:41.884500 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:41.913308 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4a5e49a7-fedb-439e-91b5-28dfa7a4c708 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1295 microversion: 2.1 time: 0.729592 Oct 04 10:35:41.917120 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 37/81] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:41 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1295 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:42.209848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-3f3f0247-f187-4069-80d0-32d1216e7722 req-469c51d8-f5ab-4092-8906-6cf445220e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72e72c6-e9d9-4819-bf29-95d38c525002", "tag": "f0010580-7a01-4869-a84a-da5533eafb8c"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:42.238748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3f3f0247-f187-4069-80d0-32d1216e7722 req-469c51d8-f5ab-4092-8906-6cf445220e51 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.238748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3f3f0247-f187-4069-80d0-32d1216e7722 req-469c51d8-f5ab-4092-8906-6cf445220e51 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.238748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3f3f0247-f187-4069-80d0-32d1216e7722 req-469c51d8-f5ab-4092-8906-6cf445220e51 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.297190 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-3f3f0247-f187-4069-80d0-32d1216e7722 req-469c51d8-f5ab-4092-8906-6cf445220e51 service nova] Creating event network-changed:f0010580-7a01-4869-a84a-da5533eafb8c for instance c72e72c6-e9d9-4819-bf29-95d38c525002 on hv-cinder-85919 Oct 04 10:35:42.298061 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3f3f0247-f187-4069-80d0-32d1216e7722 req-469c51d8-f5ab-4092-8906-6cf445220e51 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 10:35:42.299183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3f3f0247-f187-4069-80d0-32d1216e7722 req-469c51d8-f5ab-4092-8906-6cf445220e51 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 10:35:42.300477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.309595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.310484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.311580 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.312686 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.313533 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.337650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.compute.rpcapi [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 10:35:42.340300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] Releasing lock "compute-rpcapi-router" {{(pid=127628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 10:35:42.362005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a2dfb7a2-c0a7-425d-9e7e-3f4930aacb43 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461263 Oct 04 10:35:42.363393 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 45/82] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:42.378991 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:42.380344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:42.409275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.410669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.411213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.412152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.413125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.414771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.541005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-3dd719a1-04b4-4aba-b291-09680b916a9c req-8b74a393-707c-43de-94c7-2a8ca6f27f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5127c3-d06a-4548-958d-be221a9ce7f5", "tag": "ae6be7a2-79d8-4368-9eea-71bea4e593ad"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:42.572219 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3dd719a1-04b4-4aba-b291-09680b916a9c req-8b74a393-707c-43de-94c7-2a8ca6f27f5b service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.573076 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3dd719a1-04b4-4aba-b291-09680b916a9c req-8b74a393-707c-43de-94c7-2a8ca6f27f5b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.573662 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3dd719a1-04b4-4aba-b291-09680b916a9c req-8b74a393-707c-43de-94c7-2a8ca6f27f5b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.660086 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-3dd719a1-04b4-4aba-b291-09680b916a9c req-8b74a393-707c-43de-94c7-2a8ca6f27f5b service nova] Creating event network-changed:ae6be7a2-79d8-4368-9eea-71bea4e593ad for instance ed5127c3-d06a-4548-958d-be221a9ce7f5 on hv-cinder-85919 Oct 04 10:35:42.661251 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3dd719a1-04b4-4aba-b291-09680b916a9c req-8b74a393-707c-43de-94c7-2a8ca6f27f5b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 10:35:42.661929 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-3dd719a1-04b4-4aba-b291-09680b916a9c req-8b74a393-707c-43de-94c7-2a8ca6f27f5b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 10:35:42.663434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.664418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.665306 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.666882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.667566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.668278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.687246 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.compute.rpcapi [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 10:35:42.687246 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] Releasing lock "compute-rpcapi-router" {{(pid=127627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 10:35:42.711021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-71c35854-7718-4f32-aeaf-3a759f884681 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.610333 Oct 04 10:35:42.713003 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 38/83] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:35:42.729591 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:42.731048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:42.741662 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.742458 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.743807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:42.746231 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:42.747856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:42.750308 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:43.331082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:43.347705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7f9de050-9387-40a4-84ae-f65eaf72ab4b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.632608 Oct 04 10:35:43.348577 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 39/84] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:42 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:43.354086 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:43.354086 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:43.363189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:43.367764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:43.368258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:43.371624 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:43.372638 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:43.377707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:43.378313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:43.379006 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-273204e5-68eb-4df9-a407-e59e8ec0aa46 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 1.009012 Oct 04 10:35:43.379715 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 46/85] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:42 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:43.384578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:43.393760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:43.402560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:43.404411 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:43.406513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:43.407324 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:43.407894 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:43.408377 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:43.627285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:43.639428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3d9ba121-72d1-4c89-9735-376300ad4947 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1279 microversion: 2.1 time: 0.258216 Oct 04 10:35:43.647560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 47/86] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:43 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:43.653241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:43.654487 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:43.673921 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:43.674418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:43.674952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:43.675660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:43.676330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:43.677059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:43.712252 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=28 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:43.889430 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:43.900023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:43.904706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:43.906788 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-620836af-8dd3-4625-a490-587ff0476109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1340 microversion: 2.20 time: 0.557065 Oct 04 10:35:43.931730 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 40/87] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:43 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1340 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:44.225428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:44.238233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-098e5948-5656-4e0e-86f4-32bacf4cb0a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.589355 Oct 04 10:35:44.238839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 48/88] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:43 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:44.385025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:44.385025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:44.400677 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:44.407427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:44.407959 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:44.410445 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:44.410962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:44.411067 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:44.413502 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:44.413502 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:44.430734 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:44.434245 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:44.436689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:44.437871 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:44.441394 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:44.442067 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:44.824272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=38 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:45.100076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:45.108522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-06b1ac7c-319a-44d8-9b1f-8de1de952a74 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.702234 Oct 04 10:35:45.112340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 49/89] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:44 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:45.120547 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-3c285048-c459-4881-9edc-ae2fa33d9e51 req-0e9eb928-273d-4b9d-bb01-2dd0bc2ee7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3abce48-e799-41d3-8ec2-00fc9a8e059c", "tag": "d810520c-46b9-4aab-8a42-ef00c1cfd722"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:45.144804 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3c285048-c459-4881-9edc-ae2fa33d9e51 req-0e9eb928-273d-4b9d-bb01-2dd0bc2ee7b8 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:45.150564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3c285048-c459-4881-9edc-ae2fa33d9e51 req-0e9eb928-273d-4b9d-bb01-2dd0bc2ee7b8 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:45.151143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-3c285048-c459-4881-9edc-ae2fa33d9e51 req-0e9eb928-273d-4b9d-bb01-2dd0bc2ee7b8 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:45.177601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-3c285048-c459-4881-9edc-ae2fa33d9e51 req-0e9eb928-273d-4b9d-bb01-2dd0bc2ee7b8 service nova] Creating event network-changed:d810520c-46b9-4aab-8a42-ef00c1cfd722 for instance d3abce48-e799-41d3-8ec2-00fc9a8e059c on hv-cinder-85919 Oct 04 10:35:45.193987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-3c285048-c459-4881-9edc-ae2fa33d9e51 req-0e9eb928-273d-4b9d-bb01-2dd0bc2ee7b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079850 Oct 04 10:35:45.199368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 50/90] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:45.223157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:45.230019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:45.236920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:45.250338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-df577753-e0f9-41fa-861a-821003704f48 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.872451 Oct 04 10:35:45.253675 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 41/91] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:44 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:45.257819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:45.262555 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:45.265072 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:45.266145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:45.267300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:45.268731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:45.272193 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:45.273117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:45.304156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:45.308209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:45.311427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:45.312975 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:45.313646 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:45.315751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:45.639120 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:45.647975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a8bc1a3c-f6e0-4e47-8c64-fcd96bd00288 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1279 microversion: 2.1 time: 0.440843 Oct 04 10:35:45.659143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 51/92] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:45 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1279 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:45.665773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:45.666525 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:45.679906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:45.680746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:45.681401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:45.682405 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:45.683043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:45.683640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:45.834139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:45.858420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:45.860848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:45.888471 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9436e6e8-3f5b-4a58-b6c0-f9daf589cf05 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1340 microversion: 2.20 time: 0.607070 Oct 04 10:35:45.900924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 42/93] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:45 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1340 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:46.139164 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:46.140072 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:46.148253 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:46.160487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:46.160487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:46.160487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:46.160487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:46.161140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:46.696530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:46.706029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f0a3b1eb-5ef4-437c-82f5-4da16c66e5e1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.573849 Oct 04 10:35:46.712381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 43/94] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:46 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:46.717721 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:46.718350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:46.734596 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:46.736099 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:46.736614 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:46.738102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:46.740398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:46.742828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:46.797955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:46.812736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0089c1d7-b342-475a-b227-d9370fb17dac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 1.149897 Oct 04 10:35:46.831336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 52/95] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:45 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:46.848234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:46.849724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:46.864969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:46.868503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:46.869590 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:46.875050 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:46.876537 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:46.877902 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:47.590026 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:47.612252 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b53c43eb-a7ff-4b75-bbd0-66b963f0e395 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.898441 Oct 04 10:35:47.630367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 44/96] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:46 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:47.639068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:47.640190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:47.646793 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:47.647553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:47.648158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:47.649090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:47.649698 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:47.650399 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.036777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:48.053857 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f46bbf43-54f6-47bb-800e-575d5b148732 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 1.220150 Oct 04 10:35:48.054650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 53/97] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:46 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:48.077179 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:48.078018 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:48.086250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.086747 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.087381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.088144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.088747 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.089539 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.103159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:48.115141 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:48.117228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:48.118585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-34ed9844-f03c-4c18-811e-f282d2499d44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.486710 Oct 04 10:35:48.120481 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 45/98] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:47 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:48.142460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:48.144135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:48.150429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.151049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.151709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.152744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.153313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.154162 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.319527 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:48.328246 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-53397cbf-0d22-4db1-86b1-acec59f56a45 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.263849 Oct 04 10:35:48.329120 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 54/99] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:48 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:48.348558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-1a792283-5c7c-4f0a-9140-0e8be28ddc65 req-1669c5fc-da10-4851-becf-37d67403b59c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeea5c57-433b-4799-9515-799453a51522", "tag": "3fe6667c-b24b-4c09-81d9-fd02d2113f4d"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:48.366613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-1a792283-5c7c-4f0a-9140-0e8be28ddc65 req-1669c5fc-da10-4851-becf-37d67403b59c service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.369239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-1a792283-5c7c-4f0a-9140-0e8be28ddc65 req-1669c5fc-da10-4851-becf-37d67403b59c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.369687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-1a792283-5c7c-4f0a-9140-0e8be28ddc65 req-1669c5fc-da10-4851-becf-37d67403b59c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.393758 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-1a792283-5c7c-4f0a-9140-0e8be28ddc65 req-1669c5fc-da10-4851-becf-37d67403b59c service nova] Creating event network-changed:3fe6667c-b24b-4c09-81d9-fd02d2113f4d for instance eeea5c57-433b-4799-9515-799453a51522 on hv-cinder-85919 Oct 04 10:35:48.411444 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-1a792283-5c7c-4f0a-9140-0e8be28ddc65 req-1669c5fc-da10-4851-becf-37d67403b59c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066827 Oct 04 10:35:48.412303 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 55/100] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:48.599998 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:48.608607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ab8ac0ad-bacd-4f73-97ef-a476d41e1caf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.486344 Oct 04 10:35:48.609853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 46/101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:48 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:48.644336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:48.645430 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:48.652658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.653277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.654021 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.654970 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.655481 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.655972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:48.896724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:48.913165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9e599d32-6139-4e7a-86c0-621e119af682 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.268779 Oct 04 10:35:48.913165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 56/102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:48 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:48.974444 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-fdeeb55c-4713-41b6-84d5-c2e83947d2cc req-1c976c4e-3d16-452a-b89c-6ed2e18732cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11490232-8b15-4d8e-a17b-37d396ed45c8", "tag": "400684a3-ba04-4e27-a0d8-fe9481b753fe"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:48.986035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-fdeeb55c-4713-41b6-84d5-c2e83947d2cc req-1c976c4e-3d16-452a-b89c-6ed2e18732cd service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:48.986608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-fdeeb55c-4713-41b6-84d5-c2e83947d2cc req-1c976c4e-3d16-452a-b89c-6ed2e18732cd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:48.987189 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-fdeeb55c-4713-41b6-84d5-c2e83947d2cc req-1c976c4e-3d16-452a-b89c-6ed2e18732cd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.001390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-fdeeb55c-4713-41b6-84d5-c2e83947d2cc req-1c976c4e-3d16-452a-b89c-6ed2e18732cd service nova] Creating event network-changed:400684a3-ba04-4e27-a0d8-fe9481b753fe for instance 11490232-8b15-4d8e-a17b-37d396ed45c8 on hv-cinder-85919 Oct 04 10:35:49.008475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-fdeeb55c-4713-41b6-84d5-c2e83947d2cc req-1c976c4e-3d16-452a-b89c-6ed2e18732cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038933 Oct 04 10:35:49.009232 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 47/103] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:49.081178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:49.081818 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:49.089618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.090545 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.091607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.092714 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.093138 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.093703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.150219 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:49.151009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:49.160285 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.161059 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.161501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.163082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.164112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.164637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.238748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:49.246824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-92bd1ac5-9e61-4517-9a29-8ee9b5d54a40 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.170176 Oct 04 10:35:49.247477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 57/104] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:49 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:49.316779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:49.331987 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:49.334151 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:49.336333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b0c4b771-6dec-48ed-add0-fabb99e3b9dd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.194489 Oct 04 10:35:49.337366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 48/105] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:49 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:49.356508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:49.356508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:49.362866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.363447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.363958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.364724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.365276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.365837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.504563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:49.512214 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b1b9be6e-0685-41e9-a34c-d189f18f6592 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.162681 Oct 04 10:35:49.516301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 58/106] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:49 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:49.634476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:49.635089 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:49.641281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.641764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.642212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.642877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.643324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.643740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.787119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:49.801327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8774c45a-71d8-40cb-aa10-d6a03a01c8ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.170590 Oct 04 10:35:49.803261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 49/107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:49 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:49.930260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:49.930893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:49.937564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.938063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.938689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:49.939391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:49.939850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:49.940278 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.079176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:50.087186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-61c0b0bb-b913-4b93-a63a-dcb554ff1ce7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.160650 Oct 04 10:35:50.094947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 59/108] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:49 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:50.270915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:50.271713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:50.278064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.278610 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.279740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.280459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.281047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.281493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.363050 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:50.363656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:50.370730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.371214 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.371647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.374285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.374733 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.375274 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.424574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:50.433494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6739136d-854d-4c7d-9ee7-ce80b63aa922 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.166579 Oct 04 10:35:50.436497 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 50/109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:50 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:50.522525 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:50.531552 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:50.537334 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:50.537954 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:50.541245 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:50.542380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d399342b-d6e8-4c14-93dd-0399788f2a72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.183302 Oct 04 10:35:50.542943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 60/110] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:50 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:35:50.550983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.551541 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.552147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.552843 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.553482 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.553904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.709940 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:50.717802 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-04edd49e-796f-488c-9485-5a5bcac420af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.184210 Oct 04 10:35:50.718365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 51/111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:50 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:50.824270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:50.824911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:50.831140 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.831632 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.832072 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.832822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:50.833567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:50.834085 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:50.853365 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:50.971613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:50.979541 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-36a6a4e4-3c32-4cc9-8d27-f5d6d2f09866 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.159188 Oct 04 10:35:50.980114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 61/112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:50 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:51.025205 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-74d3e0a4-9fdb-4422-bbc9-b04eeb98c49c req-c071c83a-0208-4271-9c30-d4c61f08ecd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d9120a-9e5e-47d3-9c56-10fe47d51d0f", "tag": "8a351264-c070-4d96-83c2-fbab580295f1"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:51.034991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-74d3e0a4-9fdb-4422-bbc9-b04eeb98c49c req-c071c83a-0208-4271-9c30-d4c61f08ecd5 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:51.035466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-74d3e0a4-9fdb-4422-bbc9-b04eeb98c49c req-c071c83a-0208-4271-9c30-d4c61f08ecd5 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:51.035897 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-74d3e0a4-9fdb-4422-bbc9-b04eeb98c49c req-c071c83a-0208-4271-9c30-d4c61f08ecd5 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:51.047731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-74d3e0a4-9fdb-4422-bbc9-b04eeb98c49c req-c071c83a-0208-4271-9c30-d4c61f08ecd5 service nova] Creating event network-changed:8a351264-c070-4d96-83c2-fbab580295f1 for instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f on hv-cinder-85919 Oct 04 10:35:51.057119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-74d3e0a4-9fdb-4422-bbc9-b04eeb98c49c req-c071c83a-0208-4271-9c30-d4c61f08ecd5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031013 Oct 04 10:35:51.057119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 52/113] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:51.113872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:51.114493 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:51.120462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:51.120978 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:51.125242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:51.125242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:51.125242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:51.125242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:51.266408 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:51.275187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-710e940d-1528-41dd-a7ef-8544fd71fea2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.164980 Oct 04 10:35:51.276362 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 62/114] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:51 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:51.469222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:51.469222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:51.492105 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:51.493969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:51.497912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:51.503776 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:51.507579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:51.512655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:51.573278 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:51.574503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:51.583429 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:51.584128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:51.585043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:51.595937 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:51.598126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:51.612344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:52.209191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:52.219091 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:52.220693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:52.221908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7dd4c315-0ec6-4a1f-93cd-174377a98b46 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.657969 Oct 04 10:35:52.222544 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 63/115] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:51 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:52.226935 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:52.227731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:52.234566 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:52.235260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:52.235696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:52.236382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:52.236845 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:52.237511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:52.275236 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:52.286449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4af9d332-39d0-4176-b168-c30968d06f38 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.832226 Oct 04 10:35:52.287531 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 53/116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:51 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:52.296049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:52.297122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:52.305010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:52.305736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:52.306171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:52.306918 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:52.308117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:52.308888 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:52.319836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:52.337339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=10 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:52.499241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:52.507223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0b5e8201-9d9c-4756-8f65-8fa00cd43b92 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.283687 Oct 04 10:35:52.507930 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 64/117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:52 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:52.517400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:52.518259 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:52.525489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:52.526339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:52.528332 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:52.528332 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:52.528332 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:52.528332 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:52.603200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:52.618764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-712247ce-7b91-4b29-bd23-c7497d0f4843 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.328683 Oct 04 10:35:52.625017 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 54/118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:52 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:52.755263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:52.771156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8757c2bf-df1e-4f1f-baf6-2af213314efd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.261966 Oct 04 10:35:52.772424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 65/119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:52 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:53.250833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:53.251447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:53.253870 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:53.259517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.260013 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.260449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.261242 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.261856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.262611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.315801 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:53.316538 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:53.322863 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.323535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.324332 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.325721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.326505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.328484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.461853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:53.461853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:53.462018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:53.462018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c955ce85-1d43-4a6a-8c9e-bdee0ed576ff tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.176038 Oct 04 10:35:53.462018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 55/120] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:53 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:53.467946 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:53.476496 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e5a9e869-e549-4623-bca6-2f58431fddaf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.167958 Oct 04 10:35:53.477080 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 66/121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:53 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:53.532047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:53.532668 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:53.538570 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.539051 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.539483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.540172 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.540619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.541071 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.645211 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:53.645837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:53.651952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.652442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.652930 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.654193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.654699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.655121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.710588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:53.720958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3f96a603-a683-4336-8b32-31f5acb43002 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.193179 Oct 04 10:35:53.721589 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 56/122] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:53 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:53.792674 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:53.795257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:53.795863 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:53.800646 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4c6bbbc9-57f5-47fe-bb36-1a23bb232dd7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.159410 Oct 04 10:35:53.801240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 67/123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:53 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:53.801713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.802185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.802620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.803354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:53.803803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:53.804220 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:53.940200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:53.948317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e55e685a-6956-4951-aac7-a6c4928bd4ac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.156906 Oct 04 10:35:53.948970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 57/124] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:53 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:54.488657 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:54.490013 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:54.498993 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.499779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.500380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:54.501980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.503504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.504239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:54.506276 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:54.506884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:54.524318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.524818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.525307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:54.525992 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.526442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.526862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:54.779250 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:54.781223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:54.801466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-15e51e14-f713-4371-9e0f-25fc25f53535 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.288068 Oct 04 10:35:54.801682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:54.801682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:54.801682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1a388c8d-9d5e-45f0-b34e-3e2f6850299e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.316970 Oct 04 10:35:54.807935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 58/125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:54 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:54.813248 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 68/126] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:54 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:35:54.827342 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:54.827949 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:54.829107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:54.832782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:54.838382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.838875 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.839312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:54.840011 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.840462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.840981 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:54.849597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.850060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.850515 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:54.861631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:54.861631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:54.861631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:55.041409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:55.050658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d564d3c7-609c-4f5c-a634-f4a1060863af tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.239573 Oct 04 10:35:55.051175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:55.072290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-00fdf19d-609e-4b52-8fc7-40fac91c5703 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.248729 Oct 04 10:35:55.073256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 69/128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:54 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:55.075985 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 59/128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:54 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:55.079765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:55.080372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:55.097779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:55.098448 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:55.099026 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:55.099895 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:55.100486 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:55.101982 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:55.180200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-b4603bd4-55b8-4d38-a9a6-1a9299179406 req-814ba9b2-4280-491e-8a4c-b8ab9e6f5c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3abce48-e799-41d3-8ec2-00fc9a8e059c", "name": "network-vif-plugged", "status": "completed", "tag": "d810520c-46b9-4aab-8a42-ef00c1cfd722"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:55.195264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-b4603bd4-55b8-4d38-a9a6-1a9299179406 req-814ba9b2-4280-491e-8a4c-b8ab9e6f5c87 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:55.195264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-b4603bd4-55b8-4d38-a9a6-1a9299179406 req-814ba9b2-4280-491e-8a4c-b8ab9e6f5c87 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:55.195264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-b4603bd4-55b8-4d38-a9a6-1a9299179406 req-814ba9b2-4280-491e-8a4c-b8ab9e6f5c87 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:55.204920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-b4603bd4-55b8-4d38-a9a6-1a9299179406 req-814ba9b2-4280-491e-8a4c-b8ab9e6f5c87 service nova] Creating event network-vif-plugged:d810520c-46b9-4aab-8a42-ef00c1cfd722 for instance d3abce48-e799-41d3-8ec2-00fc9a8e059c on hv-cinder-85919 Oct 04 10:35:55.210672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-b4603bd4-55b8-4d38-a9a6-1a9299179406 req-814ba9b2-4280-491e-8a4c-b8ab9e6f5c87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127733 Oct 04 10:35:55.211655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 60/129] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:55.328406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:55.342344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-65a6e537-533a-457b-8daa-da7379107068 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.267705 Oct 04 10:35:55.342958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 70/130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:55 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:55.817596 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:55.818310 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:55.830243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:55.830861 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:55.842786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:55.843294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:55.843729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:55.844963 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:55.845582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:55.846312 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:55.882508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:55.883057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:55.886882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:55.888379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:55.891001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:55.893929 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:56.029281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:56.037139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-106e3db9-b842-4f11-9598-b70022249451 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.224893 Oct 04 10:35:56.037737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 61/131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:55 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:56.075160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:56.075794 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:56.081897 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:56.082374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:56.083451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:56.084148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:56.084601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:56.085046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:56.120588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:56.134981 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:56.136426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:56.137563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6e35b1c4-4f18-4f39-a052-52b8573e0d37 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.311373 Oct 04 10:35:56.139095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 71/132] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:55 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:35:56.144011 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:56.144608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:56.151209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:56.151690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:56.152114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:56.153198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:56.154129 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:56.154685 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:56.318518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:56.328414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4b42fe30-2e34-41f7-8157-32f823b50922 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.187958 Oct 04 10:35:56.329435 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 72/133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:56 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:56.330198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:56.343857 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e00940c8-85a0-4776-82b2-94f6f870ae0c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.272872 Oct 04 10:35:56.344787 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 62/134] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:56 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:56.366007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:56.366850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:56.373628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:56.374232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:56.374774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:56.375566 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:56.376110 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:56.376539 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:56.584181 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:56.593142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d639b0e3-d800-4531-884c-aa9112d86b2e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.231045 Oct 04 10:35:56.594353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 73/135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:56 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:57.059608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:57.060446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:57.066754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.067511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.068067 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.068912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.069414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.069847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.163649 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:57.164810 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:57.184404 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.188418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.188418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.188418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.188418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.188909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.218044 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:57.230834 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-62bcfd43-3bc3-4914-9f1b-95d57e0d4bf7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.174968 Oct 04 10:35:57.239744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 63/136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:57 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:57.337714 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:57.347212 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:57.348658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:57.349832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0b5fe720-9c6a-472e-8f3c-ff6a95c65491 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.190095 Oct 04 10:35:57.351762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:57.352651 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:57.362522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.363307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.364484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.371870 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 74/137] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:57 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:35:57.372743 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.372743 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.372743 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.374021 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:57.374832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:57.382678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.383379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.384004 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.384700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.385477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.386073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.546705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:57.558174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cd73c78f-2dd9-46e7-a9fd-55bf2b1eb450 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.210402 Oct 04 10:35:57.559378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 64/138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:57 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:57.623742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:57.624153 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:57.624820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:57.627662 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-eed94d61-64f0-46df-9735-82afdbaa7f2c tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.261022 Oct 04 10:35:57.628256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 75/139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:57 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:57.632406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.633049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.633702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.634658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:57.635235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:57.635671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:57.798702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:57.813689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0c685687-54f2-4808-8f11-ce55f267769a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.195903 Oct 04 10:35:57.814605 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 65/140] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:57 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:58.120988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-58287128-42e7-4844-988e-355446920f8d req-a33048ae-e88d-47b7-be16-a8a19580cac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5127c3-d06a-4548-958d-be221a9ce7f5", "name": "network-vif-plugged", "status": "completed", "tag": "ae6be7a2-79d8-4368-9eea-71bea4e593ad"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:35:58.136534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-58287128-42e7-4844-988e-355446920f8d req-a33048ae-e88d-47b7-be16-a8a19580cac5 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.137152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-58287128-42e7-4844-988e-355446920f8d req-a33048ae-e88d-47b7-be16-a8a19580cac5 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.137892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-58287128-42e7-4844-988e-355446920f8d req-a33048ae-e88d-47b7-be16-a8a19580cac5 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.150335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-58287128-42e7-4844-988e-355446920f8d req-a33048ae-e88d-47b7-be16-a8a19580cac5 service nova] Creating event network-vif-plugged:ae6be7a2-79d8-4368-9eea-71bea4e593ad for instance ed5127c3-d06a-4548-958d-be221a9ce7f5 on hv-cinder-85919 Oct 04 10:35:58.164426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-58287128-42e7-4844-988e-355446920f8d req-a33048ae-e88d-47b7-be16-a8a19580cac5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047470 Oct 04 10:35:58.165269 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 76/141] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:35:58.254658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:58.255792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:58.263881 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.264558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.265061 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.265781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.268037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.268037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.380373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:58.385764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:58.391040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.391873 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.392795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.394271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.395417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.396313 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.561639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:58.576283 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d16d59d-1bcc-4c22-a33b-3561c39e59d6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.324727 Oct 04 10:35:58.577564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 66/142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:58 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:58.599506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:58.601150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:58.601771 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:58.613985 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:58.616573 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:58.622682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ffe11f3c-8541-4a3c-b32d-1247040f150e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.246552 Oct 04 10:35:58.624034 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 77/143] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:58 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:35:58.631720 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.634400 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.634935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.635834 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.637719 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.640803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.655423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:58.656338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:58.663069 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.663984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.664594 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.665517 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.666171 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.666768 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.941226 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:58.945930 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:58.957425 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-96b3970c-4da9-456f-8d12-56b73283d9d6 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.307581 Oct 04 10:35:58.958024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 78/144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:58 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:35:58.976109 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:58.976985 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:58.988306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:58.995507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.995507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.995507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:58.995507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:58.995913 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:58.996067 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:59.117085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:59.130186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a2e35c98-5d4a-4422-ae36-68d9cdba4964 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.533793 Oct 04 10:35:59.131752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 67/145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:58 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:59.290097 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:59.301379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f57c1d51-8812-432e-ab7f-be4340bd409a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1367 microversion: 2.1 time: 0.340711 Oct 04 10:35:59.302173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 79/146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:58 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:59.603331 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:59.603811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:59.612499 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:59.613681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:59.614773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:59.615681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:59.616720 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:59.617623 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:59.653775 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:59.654797 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:59.660753 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:59.661466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:59.662059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:59.662931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:59.663383 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:59.663808 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:59.765317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:59.776290 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-50ae0783-0179-426e-a0b2-9c7ad1fc93a3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.177151 Oct 04 10:35:59.794204 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 68/147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:59 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:35:59.836259 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:59.845644 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:59.847538 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:35:59.848635 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-891b9840-e11a-405f-9490-efe837584cda tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.199063 Oct 04 10:35:59.849678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 80/148] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:35:59 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:35:59.981804 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:35:59.982542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:35:59.988456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:59.988960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:59.989401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:35:59.990082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:35:59.990532 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:35:59.990954 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.121047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:00.129821 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-22fd3525-ca24-4f7b-9ce2-fd6df3c9c528 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.151954 Oct 04 10:36:00.130390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 69/149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:35:59 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:00.154521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:00.155193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:00.161764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.162406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.162669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.163364 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.163815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.164242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.180340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-450c9996-7c5e-4cc4-bb4c-2ce440fdf247 req-1d64c536-4958-46f2-8fca-0102fae9a998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d9120a-9e5e-47d3-9c56-10fe47d51d0f", "name": "network-vif-plugged", "status": "completed", "tag": "8a351264-c070-4d96-83c2-fbab580295f1"}, {"server_uuid": "c72e72c6-e9d9-4819-bf29-95d38c525002", "name": "network-vif-plugged", "status": "completed", "tag": "f0010580-7a01-4869-a84a-da5533eafb8c"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:00.190293 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-450c9996-7c5e-4cc4-bb4c-2ce440fdf247 req-1d64c536-4958-46f2-8fca-0102fae9a998 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.190779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-450c9996-7c5e-4cc4-bb4c-2ce440fdf247 req-1d64c536-4958-46f2-8fca-0102fae9a998 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.191211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-450c9996-7c5e-4cc4-bb4c-2ce440fdf247 req-1d64c536-4958-46f2-8fca-0102fae9a998 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.211259 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-450c9996-7c5e-4cc4-bb4c-2ce440fdf247 req-1d64c536-4958-46f2-8fca-0102fae9a998 service nova] Creating event network-vif-plugged:8a351264-c070-4d96-83c2-fbab580295f1 for instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f on hv-cinder-85919 Oct 04 10:36:00.212130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-450c9996-7c5e-4cc4-bb4c-2ce440fdf247 req-1d64c536-4958-46f2-8fca-0102fae9a998 service nova] Creating event network-vif-plugged:f0010580-7a01-4869-a84a-da5533eafb8c for instance c72e72c6-e9d9-4819-bf29-95d38c525002 on hv-cinder-85919 Oct 04 10:36:00.220350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-450c9996-7c5e-4cc4-bb4c-2ce440fdf247 req-1d64c536-4958-46f2-8fca-0102fae9a998 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045192 Oct 04 10:36:00.220975 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 70/150] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:36:00.327200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:00.328501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:00.329175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:00.336474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.337349 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.338105 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.338213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c6b3123b-ca72-42cb-bb3b-335161a38cc9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.187773 Oct 04 10:36:00.339107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.346625 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.346901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 81/151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:00 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:00.347856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.495660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:00.504012 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0c6511c4-1919-4ea6-b0e7-3534f42512d8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1557 microversion: 2.1 time: 0.183396 Oct 04 10:36:00.504584 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 71/152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:00 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:00.527456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:00.532809 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:00.533976 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.534454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.534888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.535572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.536014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.536432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.705530 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2e890956-f8bc-49fd-b24f-3f17cb21d380 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181786 Oct 04 10:36:00.706789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 82/153] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:36:00 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:00.805064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:00.806525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:00.842319 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.842942 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.845714 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.847743 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.848356 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.849770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.860442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:00.875256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:00.875798 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:00.886676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.887173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.887756 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:00.888466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:00.888953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:00.889378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:01.122640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:01.140220 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:01.142783 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:01.145710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6aac41af-5b1c-4fae-89d7-1b39f2a27239 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.275186 Oct 04 10:36:01.146613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 83/154] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:36:00 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:36:01.173134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:01.173816 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:01.174673 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:01.180916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-da8d8b0f-77cb-4083-9031-d38120ff9889 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.380190 Oct 04 10:36:01.184063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:01.185178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:01.185992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:01.186543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 72/155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:00 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:01.187137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:01.187812 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:01.188435 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:01.364136 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:01.364751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:01.376599 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:01.377189 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:01.377738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:01.378751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:01.379283 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:01.379831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:01.790091 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:01.808014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6cc44065-8acd-41b2-ac67-28f23b7635c8 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.643494 Oct 04 10:36:01.811953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 84/156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:01 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:01.857154 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:01.865978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4bdee2cd-9d66-452f-bf8c-f5e1c3edb72e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.505868 Oct 04 10:36:01.866592 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 73/157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:01 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:02.179702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:02.180885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:02.187438 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.188065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.188623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.189371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.189899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.190321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.212260 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:02.213407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:02.220313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.221071 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.221985 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.222895 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.223634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.224294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.373508 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:02.382441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d7ca2de2-eec9-4805-ae99-5fc65529b3d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.175268 Oct 04 10:36:02.383374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 74/158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:02 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:02.393009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-5a00b235-87e8-470d-aa1b-4f7990e14259 req-04eb94e1-3840-45ff-a5bc-3523a8ebda1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11490232-8b15-4d8e-a17b-37d396ed45c8", "name": "network-vif-plugged", "status": "completed", "tag": "400684a3-ba04-4e27-a0d8-fe9481b753fe"}, {"server_uuid": "eeea5c57-433b-4799-9515-799453a51522", "name": "network-vif-plugged", "status": "completed", "tag": "3fe6667c-b24b-4c09-81d9-fd02d2113f4d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:02.411790 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5a00b235-87e8-470d-aa1b-4f7990e14259 req-04eb94e1-3840-45ff-a5bc-3523a8ebda1b service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.412363 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5a00b235-87e8-470d-aa1b-4f7990e14259 req-04eb94e1-3840-45ff-a5bc-3523a8ebda1b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.413398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5a00b235-87e8-470d-aa1b-4f7990e14259 req-04eb94e1-3840-45ff-a5bc-3523a8ebda1b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.425514 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:02.436005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-5a00b235-87e8-470d-aa1b-4f7990e14259 req-04eb94e1-3840-45ff-a5bc-3523a8ebda1b service nova] Creating event network-vif-plugged:400684a3-ba04-4e27-a0d8-fe9481b753fe for instance 11490232-8b15-4d8e-a17b-37d396ed45c8 on hv-cinder-85919 Oct 04 10:36:02.436829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-5a00b235-87e8-470d-aa1b-4f7990e14259 req-04eb94e1-3840-45ff-a5bc-3523a8ebda1b service nova] Creating event network-vif-plugged:3fe6667c-b24b-4c09-81d9-fd02d2113f4d for instance eeea5c57-433b-4799-9515-799453a51522 on hv-cinder-85919 Oct 04 10:36:02.444197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-5a00b235-87e8-470d-aa1b-4f7990e14259 req-04eb94e1-3840-45ff-a5bc-3523a8ebda1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058942 Oct 04 10:36:02.444947 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 75/159] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:02.452818 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:02.454056 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:02.459245 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-77edcbb0-22d6-417a-9246-84f4a691ba72 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.283299 Oct 04 10:36:02.459245 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 85/160] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:36:02 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:36:02.812939 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-ee1eff8f-b10d-437a-92e3-665aa37ce8c4 req-a4654cf4-9c66-4fcb-b56c-f5715bae1d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3abce48-e799-41d3-8ec2-00fc9a8e059c", "tag": "d810520c-46b9-4aab-8a42-ef00c1cfd722"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:02.825649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ee1eff8f-b10d-437a-92e3-665aa37ce8c4 req-a4654cf4-9c66-4fcb-b56c-f5715bae1d12 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.826245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ee1eff8f-b10d-437a-92e3-665aa37ce8c4 req-a4654cf4-9c66-4fcb-b56c-f5715bae1d12 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.826762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ee1eff8f-b10d-437a-92e3-665aa37ce8c4 req-a4654cf4-9c66-4fcb-b56c-f5715bae1d12 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.833922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:02.835871 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:02.844486 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-ee1eff8f-b10d-437a-92e3-665aa37ce8c4 req-a4654cf4-9c66-4fcb-b56c-f5715bae1d12 service nova] Creating event network-changed:d810520c-46b9-4aab-8a42-ef00c1cfd722 for instance d3abce48-e799-41d3-8ec2-00fc9a8e059c on hv-cinder-85919 Oct 04 10:36:02.849421 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.850598 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.851460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-ee1eff8f-b10d-437a-92e3-665aa37ce8c4 req-a4654cf4-9c66-4fcb-b56c-f5715bae1d12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042096 Oct 04 10:36:02.852294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 76/161] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:02.853459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.856276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.857299 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.857734 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.890773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:02.895482 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:02.904221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.905139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.905996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:02.906904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:02.908488 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:02.909431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:03.065782 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:03.076075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e4135af0-b0c3-444c-9e42-8007259cd998 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1315 microversion: 2.1 time: 0.244757 Oct 04 10:36:03.089528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:03.090028 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 86/162] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:02 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:03.101314 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c52fee52-a8c1-473c-b1bc-26934db6a29b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.215758 Oct 04 10:36:03.104501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 77/163] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:02 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:03.409078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:03.409650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:03.427605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:03.428096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:03.428532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:03.430412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:03.431153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:03.431485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:03.488350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:03.489099 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:03.496187 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:03.497887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:03.498575 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:03.499729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:03.500403 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:03.501156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:03.622488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:03.632493 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9eee19b9-e1d9-4c47-8aa7-aef61ba161b2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.229012 Oct 04 10:36:03.633896 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 87/164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:03 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:03.719557 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:03.730863 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:03.734185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:03.735505 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-00b514bf-7254-4187-85c8-ba09908f0eee tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1407 microversion: 2.20 time: 0.251952 Oct 04 10:36:03.736132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 78/165] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:36:03 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:36:04.104066 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:04.105974 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:04.117001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.117927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.118432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.119414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.119878 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.120369 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.131621 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:04.132932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:04.139770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.140620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.141550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.144003 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.144714 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.145386 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.295170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:04.307312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6138abf3-d400-4eb4-9496-e1bd5e294046 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1502 microversion: 2.1 time: 0.209924 Oct 04 10:36:04.320886 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 88/166] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:04 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1502 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:04.370007 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:04.383104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e8d3e784-e243-4380-b5ea-be0f336830a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.255158 Oct 04 10:36:04.383540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 79/167] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:04 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:04.658798 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:04.659479 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:04.681446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.681957 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.682456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.683209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.683639 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.686762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.768676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:04.772899 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:04.788892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:04.797415 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.801608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.802469 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.803864 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:04.805346 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:04.805969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:04.955836 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:04.967587 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6ea639dd-21e1-4bb3-8b4e-07fc92ced7bc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.315185 Oct 04 10:36:04.968567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 89/168] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:04 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:05.064294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:05.072630 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:05.074104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:05.075972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ae6b0948-85c7-4047-b2ca-532e465b9db0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1598 microversion: 2.20 time: 0.318289 Oct 04 10:36:05.089179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 80/169] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:36:04 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1598 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:36:05.103857 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:05.104354 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:05.110748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:05.111228 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:05.111663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:05.112377 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:05.112808 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:05.113318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:05.191036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e55afdd9-a457-48fb-bc61-00ea7a1414b5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091036 Oct 04 10:36:05.200748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 90/170] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 10:36:05 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:36:05.405463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:05.406742 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:05.413080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:05.413571 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:05.414006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:05.415381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:05.415831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:05.416466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:05.685504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:05.693400 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ac452fa6-5345-49ab-9890-ef78b9b29035 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.291677 Oct 04 10:36:05.693950 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 81/171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:05 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:05.991451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:05.992292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:05.999124 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:06.005173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:06.005173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:06.005173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:06.005173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:06.005511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:06.161660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:06.171182 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7d399eb0-194e-4046-b64f-93b993213634 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1321 microversion: 2.1 time: 0.183791 Oct 04 10:36:06.171941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 91/172] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:05 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:06.504345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3cb36cc-9848-41c8-a5dd-241e35639165"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:06.506740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:06.517190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:06.517675 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:06.521467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:06.524547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:06.525273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:06.525702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:06.718184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:06.719174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:06.726123 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:06.726943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:06.727530 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:06.728251 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:06.728709 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:06.729201 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:06.896385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:06.904300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a607264d-f804-48a7-81d5-a080540f5517 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1363 microversion: 2.1 time: 0.190138 Oct 04 10:36:06.904880 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 92/173] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:06 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:07.169788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-ff477634-82e0-404a-9523-cd5f60c1d680 req-b01b7612-fb85-42da-8c5e-05197f9945db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d9120a-9e5e-47d3-9c56-10fe47d51d0f", "tag": "8a351264-c070-4d96-83c2-fbab580295f1"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:07.191163 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ff477634-82e0-404a-9523-cd5f60c1d680 req-b01b7612-fb85-42da-8c5e-05197f9945db service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:07.191850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ff477634-82e0-404a-9523-cd5f60c1d680 req-b01b7612-fb85-42da-8c5e-05197f9945db service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:07.192579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ff477634-82e0-404a-9523-cd5f60c1d680 req-b01b7612-fb85-42da-8c5e-05197f9945db service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:07.214424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-ff477634-82e0-404a-9523-cd5f60c1d680 req-b01b7612-fb85-42da-8c5e-05197f9945db service nova] Creating event network-changed:8a351264-c070-4d96-83c2-fbab580295f1 for instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f on hv-cinder-85919 Oct 04 10:36:07.230309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-ff477634-82e0-404a-9523-cd5f60c1d680 req-b01b7612-fb85-42da-8c5e-05197f9945db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062045 Oct 04 10:36:07.231162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 93/174] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:36:07.252353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:07.253111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:07.262548 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:07.263380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:07.263821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:07.264522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:07.264997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:07.265417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:07.418352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:07.427480 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a72e7fe1-17c2-47bd-b4be-6bf10e56f733 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1516 microversion: 2.1 time: 0.194260 Oct 04 10:36:07.428058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 94/175] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:07 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:07.451176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:07.457656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:07.467556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:07.468971 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:07.469366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:07.470092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:07.470554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:07.470989 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:07.503169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'flavor' on Instance uuid 11490232-8b15-4d8e-a17b-37d396ed45c8 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:36:07.703421 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:08.001911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-287256a1-8f8b-4d36-b7ef-b90fe51cfaf0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8/action" status: 200 len: 32 microversion: 2.1 time: 0.554810 Oct 04 10:36:08.003353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 95/176] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:36:07 2022] POST /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8/action => generated 32 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 10:36:08.020673 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:08.021049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:08.030451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:08.030843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:08.031275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:08.032566 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:08.033079 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:08.033507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:08.267343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:08.294414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d2e5c250-0256-45a5-bce9-5655559df484 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1549 microversion: 2.1 time: 0.288774 Oct 04 10:36:08.295352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 96/177] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:08 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1549 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:08.313666 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:08.316272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:08.336569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:08.338487 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:08.339280 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:08.341051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:08.343306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:08.344021 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:08.620472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:08.633690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2ed2ebf9-7641-4ea0-b542-be875074c3eb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.333558 Oct 04 10:36:08.636305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 97/178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:08 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:08.642002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:08.642541 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:08.648650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:08.649458 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:08.649960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:08.650728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:08.651392 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:08.651908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:08.763031 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ec7b40c2-c606-490c-a315-da351fe3e38d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124788 Oct 04 10:36:08.764054 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 98/179] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:36:08 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:08.921792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6cd7c704-c918-40d2-93fb-e6f0c6ce9687 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "POST /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.421340 Oct 04 10:36:08.922831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 82/180] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:36:06 2022] POST /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002/os-volume_attachments => generated 194 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:09.663889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:09.665172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:09.673370 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:09.674059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:09.674668 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:09.676253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:09.677041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:09.677627 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:10.052373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:10.063272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-453b009f-d1d6-4c9e-b8a4-a89f67dda162 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.404760 Oct 04 10:36:10.063908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 99/181] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:09 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:10.480724 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-4d1eb614-8de6-47c1-bbe4-a3b42cfe619b req-47d8368b-972b-4e40-a616-d55df8619c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeea5c57-433b-4799-9515-799453a51522", "tag": "3fe6667c-b24b-4c09-81d9-fd02d2113f4d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:10.492027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4d1eb614-8de6-47c1-bbe4-a3b42cfe619b req-47d8368b-972b-4e40-a616-d55df8619c4f service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:10.492514 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4d1eb614-8de6-47c1-bbe4-a3b42cfe619b req-47d8368b-972b-4e40-a616-d55df8619c4f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:10.493190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4d1eb614-8de6-47c1-bbe4-a3b42cfe619b req-47d8368b-972b-4e40-a616-d55df8619c4f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:10.511727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-4d1eb614-8de6-47c1-bbe4-a3b42cfe619b req-47d8368b-972b-4e40-a616-d55df8619c4f service nova] Creating event network-changed:3fe6667c-b24b-4c09-81d9-fd02d2113f4d for instance eeea5c57-433b-4799-9515-799453a51522 on hv-cinder-85919 Oct 04 10:36:10.518770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-4d1eb614-8de6-47c1-bbe4-a3b42cfe619b req-47d8368b-972b-4e40-a616-d55df8619c4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042399 Oct 04 10:36:10.523171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 83/182] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:11.090831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:11.091562 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:11.098392 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:11.099052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:11.099494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:11.100203 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:11.100659 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:11.101117 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:11.279204 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:11.287296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-253ba40b-283b-47c1-9a34-e61e9499edcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.202188 Oct 04 10:36:11.287881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 100/183] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:11 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:12.312104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:12.312812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:12.322947 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:12.323440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:12.323881 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:12.325136 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:12.325723 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:12.326150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:12.495439 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:12.504581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cba493c6-b746-43a5-a571-7dd188ad0348 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.196750 Oct 04 10:36:12.509717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 84/184] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:12 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:13.532043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:13.536922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:13.544422 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:13.545359 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:13.546550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:13.547427 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:13.547883 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:13.548303 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:13.734294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:13.748791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fbb463ec-9799-4fa9-8dc3-5d2198435e25 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.222583 Oct 04 10:36:13.749413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 101/185] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:13 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:14.771625 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:14.772237 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:14.779950 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:14.780441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:14.780919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:14.781615 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:14.782069 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:14.782495 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:15.150258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:15.159547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-de88d656-c778-4f09-9426-4d79d6d0fdf4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.391789 Oct 04 10:36:15.160374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 85/186] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:14 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:16.183488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:16.184104 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:16.190322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:16.190869 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:16.191258 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:16.191953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:16.192404 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:16.192829 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:16.337095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:16.346148 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-423e16d4-e993-421f-84a8-4e83fd85eb70 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.166388 Oct 04 10:36:16.346721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 102/187] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:16 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:17.370516 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:17.371042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:17.377574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:17.378050 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:17.378484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:17.379159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:17.379607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:17.380023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:17.521911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:17.531863 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-85564c82-f0a7-42fb-b9dd-5e1451427536 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.165139 Oct 04 10:36:17.534163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 86/188] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:17 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:18.555444 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:18.556080 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:18.562995 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:18.563328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:18.563765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:18.564466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:18.564990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:18.565419 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:18.702140 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:18.706429 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0fe7c8c3-a73f-4d11-b453-5def0954e8a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.155064 Oct 04 10:36:18.706999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 103/189] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:18 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:19.731808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:19.732240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:19.738768 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:19.739246 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:19.739681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:19.740363 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:19.740813 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:19.741265 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:19.890975 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:19.899199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1fa6e924-9ee0-4205-9382-762f527adfc6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.172970 Oct 04 10:36:19.899762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 87/190] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:19 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:19.968128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:19.968629 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:20.009351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:20.009351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:20.009351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:20.009351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:20.009688 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:20.009688 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:20.009688 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:36:20.401986 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d33fabfa-eb09-4bd2-bd90-c644973683f7 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 204 len: 0 microversion: 2.1 time: 0.438377 Oct 04 10:36:20.403185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 104/191] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:36:19 2022] DELETE /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:36:20.414283 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:20.421483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:20.421693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:20.422237 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:20.422652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:20.423779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:20.424228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:20.424682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:20.581719 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:20.592484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c5a65ba4-c532-4d40-a939-32c40b10e2fe tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1554 microversion: 2.1 time: 0.182460 Oct 04 10:36:20.593258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 88/192] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:20 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:20.924265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:20.925150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:20.932273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:20.932720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:20.933163 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:20.934970 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:20.934970 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:20.935418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:21.081064 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:21.089148 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f0849283-f55c-4e6b-9cd9-ab04fcdbabda tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.169545 Oct 04 10:36:21.089715 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 105/193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:20 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:21.618361 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:21.623055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:21.627160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:21.627790 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:21.628333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:21.629170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:21.629659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:21.630153 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:21.654919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:21.776471 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:21.788636 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a1792545-0de5-4c84-a99b-4104b8afec69 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1554 microversion: 2.1 time: 0.174787 Oct 04 10:36:21.789256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 89/194] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:21 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:22.115645 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:22.116256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:22.122601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:22.123084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:22.128760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:22.128760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:22.128760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:22.128760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:22.258168 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:22.267421 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-10cc8869-31fe-4990-80a8-a73e42f3481a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.155649 Oct 04 10:36:22.268074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 106/195] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:22 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:22.815597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:22.816336 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:22.824800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:22.825439 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:22.826048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:22.826865 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:22.827544 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:22.828073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:23.245709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:23.255162 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-03028c62-ae87-4917-b28c-db3b75e5fb66 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1554 microversion: 2.1 time: 0.444238 Oct 04 10:36:23.255746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 90/196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:22 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1554 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:23.294576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:23.295194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:23.302472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:23.302960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:23.303566 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:23.304441 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:23.305019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:23.305363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:23.479022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:23.489399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-40e8a109-de14-48e7-af01-cc5c45df3c33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.200351 Oct 04 10:36:23.490035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 107/197] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:23 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:23.865408 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-d65e4ec2-5458-4928-b95b-6996abbcece5 req-f40f06dd-97be-41e0-8e46-76f60f1dfefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72e72c6-e9d9-4819-bf29-95d38c525002", "name": "network-vif-deleted", "tag": "f0010580-7a01-4869-a84a-da5533eafb8c"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:23.878384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d65e4ec2-5458-4928-b95b-6996abbcece5 req-f40f06dd-97be-41e0-8e46-76f60f1dfefd service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:23.879292 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d65e4ec2-5458-4928-b95b-6996abbcece5 req-f40f06dd-97be-41e0-8e46-76f60f1dfefd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:23.880194 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-d65e4ec2-5458-4928-b95b-6996abbcece5 req-f40f06dd-97be-41e0-8e46-76f60f1dfefd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:23.893192 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-d65e4ec2-5458-4928-b95b-6996abbcece5 req-f40f06dd-97be-41e0-8e46-76f60f1dfefd service nova] Creating event network-vif-deleted:f0010580-7a01-4869-a84a-da5533eafb8c for instance c72e72c6-e9d9-4819-bf29-95d38c525002 on hv-cinder-85919 Oct 04 10:36:23.898713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-d65e4ec2-5458-4928-b95b-6996abbcece5 req-f40f06dd-97be-41e0-8e46-76f60f1dfefd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040995 Oct 04 10:36:23.899404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 91/198] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:24.279407 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:24.280319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:24.286758 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:24.287318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:24.287852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:24.288628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:24.289326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:24.293822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:24.363424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:24.373600 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b200d865-2bcf-4a6a-b08e-a3c3dafe59c1 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1346 microversion: 2.1 time: 0.098837 Oct 04 10:36:24.374279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 108/199] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:24 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:24.515110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:24.515757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:24.523173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:24.523692 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:24.524191 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:24.524922 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:24.525496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:24.525853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:24.677684 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:24.686092 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ea3fccd7-e2d8-4550-a65f-7868a5858f18 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.176184 Oct 04 10:36:24.686666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 92/200] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:24 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:25.397637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:25.398292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:25.405316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:25.405924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:25.406363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:25.407089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:25.407621 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:25.408124 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:25.442683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:25.443210 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:25.443716 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:25.444190 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lazy-loading 'fault' on Instance uuid c72e72c6-e9d9-4819-bf29-95d38c525002 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:36:25.491180 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b69eb143b5d42c3b4a8cb292c6a70d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7330488d40469199873490c5fd2bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:25.495484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:25.500636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-47fdd0c9-d48e-43cc-802e-164edae0dadd tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 200 len: 1351 microversion: 2.1 time: 0.107025 Oct 04 10:36:25.501257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 109/201] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:25 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:25.710747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:25.711460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:25.718757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:25.719243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:25.719689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:25.720378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:25.720964 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:25.721575 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:25.920910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:25.931863 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4d0b31e5-11d0-4fee-8e5c-9c689cf64fb4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.225614 Oct 04 10:36:25.932760 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 93/202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:25 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:26.523969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:26.524618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:26.532021 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:26.532536 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:26.533009 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:26.533765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:26.534221 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:26.534657 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:26.549444 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] HTTP exception thrown: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Request method failure captured: Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 HTTP/1.1 Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxoeMsTf4ySIKumPjHcWCyfEZKThjIvRhqK8-Gsqo-dQYAMYpGQLxjtE7kc_C7CR9Dcb4qAC_N2oNHJk23bXGXtD3BHTUrokiLjwdPDEmXHRxt1K_BOmT4WnDLKtDBr7AnVLh7IJP-TTjmdBCFIbT8rjnG-CZFzWlJEVQEt8d8s7xA Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:36:26.557101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2e7330488d40469199873490c5fd2bb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 7b69eb143b5d42c3b4a8cb292c6a70d7 Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.558579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'c72e72c6-e9d9-4819-bf29-95d38c525002'} Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:36:26.559417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.560925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.562073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Returning 404 to user: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:36:26.562073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2aaf2be8-1a80-48a3-b24e-1c9871b6a113 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 404 len: 111 microversion: 2.1 time: 0.036127 Oct 04 10:36:26.562073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 110/203] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:26 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:36:26.721561 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:26.724244 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:26.731912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:26.732395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:26.732831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:26.733548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:26.734006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:26.734424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:26.748442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] HTTP exception thrown: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Request method failure captured: Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002/os-volume_attachments HTTP/1.1 Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxoeMsTf4ySIKumPjHcWCyfEZKThjIvRhqK8-Gsqo-dQYAMYpGQLxjtE7kc_C7CR9Dcb4qAC_N2oNHJk23bXGXtD3BHTUrokiLjwdPDEmXHRxt1K_BOmT4WnDLKtDBr7AnVLh7IJP-TTjmdBCFIbT8rjnG-CZFzWlJEVQEt8d8s7xA Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:36:26.752932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2e7330488d40469199873490c5fd2bb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 7b69eb143b5d42c3b4a8cb292c6a70d7 Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.754433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'server_id': 'c72e72c6-e9d9-4819-bf29-95d38c525002'} Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:36:26.755317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:26.756707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:26.758731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Returning 404 to user: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:36:26.758731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4db1bfd4-ab11-408a-ace6-ececf96f37cc tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036825 Oct 04 10:36:26.758731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 94/204] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:36:26 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:36:26.964489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:26.965748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:26.972326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:26.972829 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:26.977185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:26.977185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:26.977185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:26.977185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:27.137940 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:27.146901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0dbc549f-75fb-4816-90bf-86318548cd94 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.186474 Oct 04 10:36:27.147628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 111/205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:26 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:28.160785 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:28.161517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:28.169684 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:28.170448 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:28.170885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:28.171657 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:28.172111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:28.172530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:28.174390 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:28.175311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:28.182839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:28.183152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:28.185782 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:28.186651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:28.187695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:28.188113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:28.188493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] HTTP exception thrown: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Request method failure captured: Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 HTTP/1.1 Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxoeMsTf4ySIKumPjHcWCyfEZKThjIvRhqK8-Gsqo-dQYAMYpGQLxjtE7kc_C7CR9Dcb4qAC_N2oNHJk23bXGXtD3BHTUrokiLjwdPDEmXHRxt1K_BOmT4WnDLKtDBr7AnVLh7IJP-TTjmdBCFIbT8rjnG-CZFzWlJEVQEt8d8s7xA Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:36:28.190744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2e7330488d40469199873490c5fd2bb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 7b69eb143b5d42c3b4a8cb292c6a70d7 Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.192183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'c72e72c6-e9d9-4819-bf29-95d38c525002'} Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:36:28.193134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.194301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.195401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Returning 404 to user: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:36:28.195401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b587b697-ab8f-4f9a-81c9-8cd149c49847 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 404 len: 111 microversion: 2.1 time: 0.035288 Oct 04 10:36:28.195401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 95/206] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:36:28 2022] DELETE /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:36:28.201810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:28.202572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] [instance: c72e72c6-e9d9-4819-bf29-95d38c525002] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:28.210984 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:28.211466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:28.213671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:28.213671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:28.214114 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:28.214428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:28.235857 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] HTTP exception thrown: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Request method failure captured: Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 HTTP/1.1 Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxoeMsTf4ySIKumPjHcWCyfEZKThjIvRhqK8-Gsqo-dQYAMYpGQLxjtE7kc_C7CR9Dcb4qAC_N2oNHJk23bXGXtD3BHTUrokiLjwdPDEmXHRxt1K_BOmT4WnDLKtDBr7AnVLh7IJP-TTjmdBCFIbT8rjnG-CZFzWlJEVQEt8d8s7xA Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:36:28.238498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2e7330488d40469199873490c5fd2bb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e7330488d40469199873490c5fd2bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 2e7330488d40469199873490c5fd2bb4 Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-DeleteServersTestJSON-1214112312 Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 7b69eb143b5d42c3b4a8cb292c6a70d7 Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-DeleteServersTestJSON-1214112312-project Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.243667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'c72e72c6-e9d9-4819-bf29-95d38c525002'} Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:36:28.244951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. Oct 04 10:36:28.247611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:36:28.249835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] Returning 404 to user: Instance c72e72c6-e9d9-4819-bf29-95d38c525002 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:36:28.249835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2187d20f-7eaa-426f-a914-9a0a4c8b2ef4 tempest-DeleteServersTestJSON-1214112312 tempest-DeleteServersTestJSON-1214112312-project] 10.222.0.42 "GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002" status: 404 len: 111 microversion: 2.1 time: 0.042736 Oct 04 10:36:28.249835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 96/207] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:28 2022] GET /compute/v2.1/servers/c72e72c6-e9d9-4819-bf29-95d38c525002 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:36:28.479306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:28.488236 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4570f287-30a2-4593-a08a-aea79b8e29bf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.321744 Oct 04 10:36:28.488809 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 112/208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:28 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:29.517411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:29.519028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:29.531349 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:29.532418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:29.533075 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:29.534140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:29.534974 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:29.535656 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:29.698372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:29.707536 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e52f831a-cd2b-42fe-854d-f016ba3871d1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.199268 Oct 04 10:36:29.708084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 97/209] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:29 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:30.732869 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:30.733814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:30.736785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:30.743176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:30.743661 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:30.744090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:30.745022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:30.745487 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:30.746931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:30.907972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:30.920168 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-73ee5ca0-fc6b-496e-b23d-940ae20d87e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.191720 Oct 04 10:36:30.921573 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 113/210] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:30 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:31.946836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:31.947689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:31.965175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:31.965175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:31.965175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:31.965175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:31.966368 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:31.967268 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:32.173316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:32.182198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-388523d9-b97a-46b8-8617-8d1bc7c15503 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.240546 Oct 04 10:36:32.183279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 98/211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:31 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:33.206233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:33.206836 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:33.213538 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:33.214093 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:33.214576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:33.215841 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:33.216295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:33.216724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:33.350238 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:33.359352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-43651027-cd6a-479a-93b0-eac464a0ae98 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.157171 Oct 04 10:36:33.359937 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 114/212] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:33 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:34.384987 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:34.385762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:34.392872 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:34.393445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:34.393926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:34.394672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:34.395118 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:34.395553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:34.539134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:34.548910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5dad5087-14fb-456e-97e0-12a0b64c2c85 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.168411 Oct 04 10:36:34.550025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 99/213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:34 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:35.577959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:35.578567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:35.584892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:35.585396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:35.585831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:35.586514 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:35.586967 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:35.587390 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:35.740546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:35.749684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-08830d14-4e5b-44a7-9aaf-d99f5f19e136 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.176579 Oct 04 10:36:35.750427 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 115/214] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:35 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:36.773867 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:36.774494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:36.777435 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=39 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:36.782222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:36.782705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:36.783144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:36.783845 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:36.784296 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:36.784720 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:36.920603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:36.930608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-47048bfc-a2f7-4969-b725-621ed46d1345 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.160579 Oct 04 10:36:36.931280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 100/215] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:36 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:37.953934 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:37.954454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:37.961697 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:37.962197 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:37.962748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:37.963486 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:37.963942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:37.964916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:38.107644 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:38.115272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-75af6420-3135-4a2a-8379-766e5c5e12df tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.165322 Oct 04 10:36:38.115843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 116/216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:37 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:39.139540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:39.140703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:39.148340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:39.148826 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:39.149344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:39.150044 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:39.150496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:39.150915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:39.299903 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:39.309119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8b7d9827-c0c6-4072-9ad7-64c4733e76a7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.174225 Oct 04 10:36:39.309690 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 101/217] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:39 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:40.333586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:40.334449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:40.340467 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:40.340976 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:40.341411 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:40.342104 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:40.342559 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:40.342986 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:40.488975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:40.498592 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0b162c4b-f124-4cb4-ac9a-1dfe274151fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1522 microversion: 2.1 time: 0.167531 Oct 04 10:36:40.498592 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 117/218] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:40 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:41.522035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:41.524676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:41.530180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:41.530678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:41.531160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:41.531906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:41.532362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:41.532786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:41.672772 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:41.680560 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fe405e6d-6fa4-4254-b503-8ba45685f5c1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1502 microversion: 2.1 time: 0.163326 Oct 04 10:36:41.681233 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 102/219] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:41 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:41.703866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:41.704480 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:41.710885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:41.711417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:41.711847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:41.712528 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:41.713004 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:41.713422 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:41.846762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:41.854590 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8a2b5302-3a4f-4fb4-b7a1-b3d02ef2ae42 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1516 microversion: 2.1 time: 0.154404 Oct 04 10:36:41.855650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 118/220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:41 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:45.879582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:45.882605 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:45.891948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:45.892474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:45.893117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:45.893829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:45.894287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:45.894736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:45.920701 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'flavor' on Instance uuid ed5127c3-d06a-4548-958d-be221a9ce7f5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:36:46.291415 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-90aa2733-d2ed-402e-a0ec-5e889582755e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5/action" status: 200 len: 32 microversion: 2.1 time: 0.415814 Oct 04 10:36:46.296837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 103/221] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:36:45 2022] POST /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:36:46.302086 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:46.302698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:46.334240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:46.334740 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:46.335186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:46.335895 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:46.336355 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:46.336829 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:46.504356 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:46.513661 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9bd8f12d-db1b-4a20-b46a-38dddce5a449 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.215356 Oct 04 10:36:46.514576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 119/222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:46 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:47.539419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:47.543312 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:47.550961 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:47.551445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:47.551957 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:47.552581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:47.553059 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:47.553519 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:47.704755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:47.713191 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8aa4b4b9-b956-43c4-9e45-94ed07c0f166 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.178712 Oct 04 10:36:47.713763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 104/223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:47 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:47.848007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:47.848896 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:47.855423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:47.856023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:47.856561 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:47.857567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:47.858118 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:47.858734 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:47.892238 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-dd3c79e7-a641-46e7-b512-4c2e0e3bc132 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/ips" status: 200 len: 150 microversion: 2.1 time: 0.048093 Oct 04 10:36:47.893270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 120/224] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:36:47 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:48.738074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:48.741027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:48.745812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:48.746477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:48.747140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:48.747862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:48.748452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:48.749166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:48.951161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:48.960573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8cf0e181-ab52-4de9-92e8-6dc515c76ab2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.226098 Oct 04 10:36:48.973828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 105/225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:48 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:49.957827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "597d4180-5cab-4e30-901b-73adb08c095a"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:36:49.961080 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:49.967478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:49.967953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:49.968591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:49.969308 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:49.969769 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:49.970196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:49.987569 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:49.988400 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:50.014088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:50.016264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:50.016712 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:50.017456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:50.017910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:50.018335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:50.174823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:50.178343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:50.183528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-45563540-d413-413f-90cf-319bbdaa051f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.201724 Oct 04 10:36:50.184093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 106/226] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:49 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:51.207678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:51.208318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:51.215958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:51.216444 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:51.216902 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:51.217593 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:51.218046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:51.218469 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:51.286472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-01098ef6-944a-4c95-8b26-83653a723b5f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.333129 Oct 04 10:36:51.287151 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 121/227] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:36:49 2022] POST /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments => generated 194 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:36:51.359194 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:51.367018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d82bf86d-2b6e-41f5-958f-ff7d46d3caa5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.163532 Oct 04 10:36:51.367595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 107/228] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:51 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:52.392198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:52.393055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:52.399278 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:52.399789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:52.400227 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:52.400929 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:52.401500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:52.402036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:52.537398 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:52.544327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-42f14328-45d2-444b-a97e-34722196eeea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.156828 Oct 04 10:36:52.545276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 122/229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:52 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:36:53.569279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:53.569897 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:53.576878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:53.577389 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:53.577831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:53.578538 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:53.578993 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:53.579424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:53.714010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:53.721820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ac0fe4fc-79a4-459b-b9fd-129e65ee92ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.156823 Oct 04 10:36:53.722390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 108/230] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:53 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:54.745140 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:54.746230 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:54.752821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:54.753462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:54.753773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:54.754549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:54.754971 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:54.755395 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:54.889102 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:54.896931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-19ce4dfd-4c78-4115-903c-684f7845f151 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.155807 Oct 04 10:36:54.897624 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 123/231] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:54 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:55.920541 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:55.921200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:55.927355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:55.927835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:55.928271 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:55.929002 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:55.929459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:55.929924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:56.088045 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:56.096566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d76ea0cc-d1f1-4dbf-808d-af395b073cb0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.180277 Oct 04 10:36:56.097175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 109/232] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:55 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:57.125070 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:57.126105 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:57.137882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:57.138556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:57.138914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:57.144090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:57.144090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:57.144090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:57.283057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:57.290675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-de960f8d-faeb-4969-870e-8740c1cc28b3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.171523 Oct 04 10:36:57.291242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 124/233] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:57 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:58.318034 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:58.318655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:58.326421 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:58.326904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:58.327338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:58.328065 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:58.328535 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:58.328996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:58.474782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:58.483489 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-423d1730-0957-4f40-a92c-c205bcfd0018 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.169419 Oct 04 10:36:58.484181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 110/234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:58 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:36:59.512297 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:36:59.512944 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:36:59.519797 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:59.520319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:59.520747 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:59.521557 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:36:59.522035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:36:59.522455 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:36:59.526679 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:59.668043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:36:59.676132 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8103f9b8-0ea3-42ec-8239-87d8aacab19b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.168157 Oct 04 10:36:59.677734 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 125/235] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:36:59 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:00.707583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:00.708445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:00.718865 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:00.719351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:00.720003 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:00.720792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:00.721651 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:00.721790 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:00.883674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:00.892053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b581dabc-c7ab-46e6-bdde-a5d638bb1a2e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.191797 Oct 04 10:37:00.892630 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 111/236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:00 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:01.916053 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:01.916700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:01.923630 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:01.924117 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:01.924557 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:01.925282 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:01.925736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:01.926167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:02.056336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:02.064877 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f1985b01-8200-420d-a5e7-37b0acb315c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.153005 Oct 04 10:37:02.065469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 126/237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:01 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:02.615329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:02.615887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:02.624028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:02.624513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:02.624972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:02.625674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:02.626152 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:02.626574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:02.652197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-98e8a4dc-d7a7-4ec9-8128-09ef1a2d8979 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/ips" status: 200 len: 151 microversion: 2.20 time: 0.040161 Oct 04 10:37:02.652799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 112/238] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Oct 4 10:37:02 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:37:03.091568 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:03.092175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:03.098670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:03.099156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:03.099586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:03.100281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:03.100728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:03.101176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:03.248604 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:03.256575 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c711dec1-2505-4afe-9462-c22bdb96f7fb tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.169709 Oct 04 10:37:03.257329 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 127/239] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:03 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:03.310961 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d9afff8b-6a2d-45da-a45b-5ca38411297c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: .version_select at 0x7f9be95cf550>, body: {"keypair": {"name": "tempest-keypair-1014694578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8Il8sj3xqJYBOvPgd/iylGnJRtIRsvuQLX6g33auZnqzeKPyNcMJqET//eqdN2ccKbqP6c9NqirQMyEQ41TCfsnc8qpCkJ9hxY4MySSaXHk1zfqlrHP66rRxAlTCbUyA=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:03.328422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-d9afff8b-6a2d-45da-a45b-5ca38411297c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:37:03.332223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-d9afff8b-6a2d-45da-a45b-5ca38411297c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:37:03.483908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d9afff8b-6a2d-45da-a45b-5ca38411297c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177557 Oct 04 10:37:03.484441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 113/240] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:37:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:04.280647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:04.281453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:04.289280 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:04.289849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:04.290287 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:04.291169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:04.291630 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:04.294249 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:04.428072 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:04.437113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-14276113-3559-453f-81f5-e72c8e64d1ed tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.160486 Oct 04 10:37:04.437684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 128/241] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:04 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:05.462058 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:05.462588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:05.468582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:05.469098 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:05.469554 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:05.470218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:05.470670 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:05.471094 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:05.574660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:05.575351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:05.581944 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:05.582791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:05.583323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:05.584378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:05.584949 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:05.585586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:05.621102 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lazy-loading 'flavor' on Instance uuid 64d9120a-9e5e-47d3-9c56-10fe47d51d0f {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:37:05.624171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:05.635131 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-28420672-9d2a-419b-b7f7-2c5c639c39b4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.177747 Oct 04 10:37:05.635750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 114/242] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:05 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:06.413458 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c24acf95-b017-4d80-b07a-84e08bfa64d2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/action" status: 202 len: 0 microversion: 2.20 time: 0.842523 Oct 04 10:37:06.414053 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 129/243] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 10:37:05 2022] POST /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/action => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 10:37:06.422815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:06.423619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:06.429514 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:06.429995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:06.430427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:06.431116 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:06.431561 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:06.432505 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:06.452421 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1446091347", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1"}], "security_groups": [{"name": "tempest-securitygroup--696871563"}], "key_name": "tempest-keypair-1014694578", "user_data": "}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:06.464982 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=34 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:06.574607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] validate_networks() for [('2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:37:06.585279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:06.597441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:06.599084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:06.600313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9966e007-9041-4db4-b327-7b5006b00897 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.181524 Oct 04 10:37:06.600934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 115/244] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:06 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:06.605903 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:06.606452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:06.624188 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:06.624853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:06.625441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:06.626207 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:06.626726 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:06.627216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:06.652025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d60bf018-c498-4a58-b795-0d8e06ad09c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/ips" status: 200 len: 146 microversion: 2.1 time: 0.049829 Oct 04 10:37:06.652603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 116/245] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:37:06 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:06.657860 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:06.658539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:06.665249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:06.665809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:06.666345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:06.667366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:06.667941 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:06.668432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:06.829830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:06.840174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-44fe0f12-9d8c-4412-b189-ab997394ab59 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.185894 Oct 04 10:37:06.841452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 117/246] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:06 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:07.250326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:37:07.250786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:37:07.251290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:37:07.251603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:37:07.252191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:37:07.263895 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:07.265291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:07.265731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:07.266469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:07.266919 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:07.267516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:07.286850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:37:07.290960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:37:07.309616 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:37:07.309616 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:37:07.515566 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0ae1a47d-1b92-4104-a9f8-b83db08f27ad tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.068734 Oct 04 10:37:07.516217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 130/247] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:37:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 10:37:07.529017 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-26f99917-0fa2-4a9f-b5a1-6590b4bfb110 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:07.529638 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-26f99917-0fa2-4a9f-b5a1-6590b4bfb110 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:07.601233 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-26f99917-0fa2-4a9f-b5a1-6590b4bfb110 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:07.608289 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-26f99917-0fa2-4a9f-b5a1-6590b4bfb110 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1242 microversion: 2.1 time: 0.084797 Oct 04 10:37:07.609321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 118/248] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:07 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:07.631780 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:07.632653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:07.642563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:07.645143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:07.645143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:07.645843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:07.646638 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:07.647107 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:07.802360 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:07.811766 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:07.813810 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:07.815499 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bb5c6822-1c5d-4ada-be25-ffbda616daba tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.188784 Oct 04 10:37:07.816125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 131/249] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:07 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:07.863476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:07.864089 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:07.871436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:07.871951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:07.872387 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:07.873301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:07.873750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:07.874339 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:08.055637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:08.060779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2ede5a9e-0576-4bfc-ae42-4bee52f34dee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.201147 Oct 04 10:37:08.061385 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 119/250] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:07 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:08.653102 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0ee61aff-7607-4954-88b6-4ec707cdac58 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:08.653102 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0ee61aff-7607-4954-88b6-4ec707cdac58 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:08.703605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0ee61aff-7607-4954-88b6-4ec707cdac58 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:08.707866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0ee61aff-7607-4954-88b6-4ec707cdac58 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1242 microversion: 2.1 time: 0.076983 Oct 04 10:37:08.721285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 132/251] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:08 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:08.843643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:08.844350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:08.851043 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:08.851530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:08.852029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:08.852828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:08.853301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:08.854405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:09.022000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:09.031208 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:09.032653 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:09.033848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ecb152a8-ba03-4462-acce-e5b7ade4e109 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.194280 Oct 04 10:37:09.049370 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 120/252] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:08 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:09.084955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:09.085552 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:09.092213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:09.092693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:09.093157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:09.093843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:09.094289 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:09.094710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:09.224802 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:09.232641 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9326ae28-e44f-4b15-9ee0-4348c8d664c4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.151871 Oct 04 10:37:09.233246 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 133/253] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:09 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:09.732635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:09.733188 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:09.735030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:09.739661 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:09.740140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:09.740582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:09.741289 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:09.741745 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:09.742171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:09.818812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:09.827716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dab668b1-12fd-4100-b1e9-1a45f4ded521 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1294 microversion: 2.1 time: 0.099334 Oct 04 10:37:09.853135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 121/254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:09 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:09.860693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c70e99f-331e-497e-b854-5aa2ec8b250d"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:09.863352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:09.870325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:09.870984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:09.871414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:09.872099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:09.872547 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:09.872988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:10.059926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:10.060565 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:10.067466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:10.067952 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:10.068487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:10.069206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:10.069658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:10.070159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:10.217417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:10.226556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:10.227988 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:10.229864 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0959534d-003d-4b1a-8316-391d119e81ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.173698 Oct 04 10:37:10.230446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 122/255] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:10 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:10.256286 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:10.256715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:10.263764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:10.264537 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:10.265650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:10.267799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:10.268904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:10.269345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:10.404050 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:10.411774 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c63cf775-cf3c-4fe1-b5fb-b6090be3c9c6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.160239 Oct 04 10:37:10.412342 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 123/256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:10 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:10.852248 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:10.853170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:10.859394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:10.859949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:10.860606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:10.861393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:10.862682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:10.863111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.073149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:11.082493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-96c9e9e4-1990-4e48-b202-60f5c6b24626 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1294 microversion: 2.1 time: 0.234545 Oct 04 10:37:11.083433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 124/257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:10 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1294 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:11.258765 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:11.363213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:11.363213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.363213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.363213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.365452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.365452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.365452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.476889 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:11.485895 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:11.487360 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:11.488504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5926ccce-37b9-4649-be95-12592a80df3a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.236968 Oct 04 10:37:11.489097 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 125/258] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:11 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:11.493769 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:11.494842 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:11.500799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.506281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.506281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.506281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.506281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.506645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.507226 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:11.669868 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-49cb324f-cdaa-4db2-be05-d2d12eb531af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.812775 Oct 04 10:37:11.671062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 134/259] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:37:09 2022] POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-volume_attachments => generated 194 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:37:11.800797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:11.809441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7db22c67-28ea-43bf-aeab-e0745ed3b3d3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1502 microversion: 2.1 time: 0.319335 Oct 04 10:37:11.810205 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 126/260] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:11 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:11.834445 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9213519-4ae7-4cb6-a423-fdbb8294d6f1"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:11.837232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:11.843859 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.844343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.844780 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.845509 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.845994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.846417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.878760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] HTTP exception thrown: Cannot 'attach_volume' instance ed5127c3-d06a-4548-958d-be221a9ce7f5 while it is in vm_state rescued Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Request method failure captured: Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: POST /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5/os-volume_attachments HTTP/1.1 Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 74 Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxrmNYd0EZ-22UGk_kKNY6-0U_YRbMfiBo-fxh7FZTtqb9rUroRPcVLUU-SbHpoTBcklmVbnvHkoYEQdtmLGXc7YkGQnXycCpMq6KhWtCeEcQxXaTCbjv5IgzPz4dGOSeijd4m0FZuRhHTH7qqPMbzi5nZUEFx_XbtAY9B33MXP2Vc Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:37:11.881024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e94e5705bcfd476e87b2fa0af6ff597a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: c4f4844eb5e14d789476cfb44e2516f0 Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {"volumeAttachment": {"volumeId": "a9213519-4ae7-4cb6-a423-fdbb8294d6f1"}} Oct 04 10:37:11.882500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Cannot 'attach_volume' instance ed5127c3-d06a-4548-958d-be221a9ce7f5 while it is in vm_state rescued Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'server_id': 'ed5127c3-d06a-4548-958d-be221a9ce7f5', 'body': {'volumeAttachment': {'volumeId': 'a9213519-4ae7-4cb6-a423-fdbb8294d6f1'}}} Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed5127c3-d06a-4548-958d-be221a9ce7f5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:37:11.883296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ed5127c3-d06a-4548-958d-be221a9ce7f5 while it is in vm_state rescued Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:37:11.884485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:37:11.887099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:37:11.887099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:37:11.887099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ed5127c3-d06a-4548-958d-be221a9ce7f5 while it is in vm_state rescued Oct 04 10:37:11.887099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:37:11.887099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Returning 409 to user: Cannot 'attach_volume' instance ed5127c3-d06a-4548-958d-be221a9ce7f5 while it is in vm_state rescued {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:37:11.887099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3ccf5624-e3fc-4980-84ca-f39eeef158b7 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053209 Oct 04 10:37:11.887099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 135/261] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:37:11 2022] POST /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:37:11.892580 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:11.893207 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:11.900025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.900520 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.901032 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:11.901727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:11.902178 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:11.902598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:12.107786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:12.108744 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:12.122261 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:12.123096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:12.123615 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:12.124325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:12.124777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:12.125268 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:12.196367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:12.205531 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7f3a78dd-18d7-4a91-a82a-f020afb573bd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1312 microversion: 2.1 time: 0.102911 Oct 04 10:37:12.206191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 136/262] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:12 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:12.257512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c912f52e-8a57-48aa-a771-27f814367fcf tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5/action" status: 202 len: 0 microversion: 2.1 time: 0.368741 Oct 04 10:37:12.264309 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 127/263] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:37:11 2022] POST /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:37:12.271226 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:12.271825 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:12.278241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:12.278722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:12.279177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:12.279867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:12.280313 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:12.280732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:12.426518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:12.436146 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2f7826fd-fcef-4f23-91c7-863d2512dc5e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.168720 Oct 04 10:37:12.451632 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 137/264] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:12 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:12.516734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:12.517414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:12.523840 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:12.524324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:12.524759 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:12.525894 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:12.526566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:12.527028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:12.699451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:12.707706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:12.709428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:12.710573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-14c7c762-8361-4157-8df5-9f9be2a0fc65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.199190 Oct 04 10:37:12.711119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 128/265] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:12 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:13.228637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:13.229477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:13.236258 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:13.236720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:13.237212 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:13.237873 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:13.238320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:13.238738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:13.371295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:13.378921 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cdfdc706-83f3-4702-8543-d52cdacf8c7d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.154273 Oct 04 10:37:13.379483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 138/266] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:13 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:13.458595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:13.459592 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:13.466674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:13.467165 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:13.467599 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:13.468295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:13.468762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:13.469218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:13.601908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:13.609693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-774d6e72-c45e-4a07-b758-db3f988939d4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.155052 Oct 04 10:37:13.610288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 129/267] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:13 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:13.738076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:13.738606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:13.744635 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:13.745244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:13.745687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:13.746372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:13.746899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:13.747343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:13.883476 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:13.892567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:13.894060 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:13.895226 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ab5bce78-8911-42b9-a844-663f9f07a0f8 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.161225 Oct 04 10:37:13.895812 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 139/268] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:13 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:14.401970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:14.402662 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:14.408664 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:14.409204 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:14.409820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:14.410542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:14.410985 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:14.411416 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:14.546244 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:14.553940 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5f879658-12d0-4b49-80d6-1fb328ea7211 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.156374 Oct 04 10:37:14.554512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 130/269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:14 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:14.632673 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:14.633318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:14.640749 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:14.641265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:14.641704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:14.642391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:14.642845 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:14.643266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:14.658924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:14.777129 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:14.784611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bf0e6fa1-f994-4420-8ca4-106ae143ac06 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.155754 Oct 04 10:37:14.785208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 140/270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:14 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:14.925612 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:14.925612 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:14.928224 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:14.928705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:14.929185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:14.932317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:14.932317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:14.932317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:15.061953 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:15.070350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:15.071805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:15.073188 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c9f7ed99-4957-45c5-8217-30cd39e5b3d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.155353 Oct 04 10:37:15.074828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 131/271] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:14 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:15.578286 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:15.578941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:15.585592 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:15.586070 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:15.586500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:15.587179 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:15.587625 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:15.588092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:15.750882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:15.762477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7c70c15e-a9dd-4054-9b50-8d82ab203b89 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.188303 Oct 04 10:37:15.764176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 141/272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:15 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:15.809590 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:15.810382 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:15.816940 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:15.817430 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:15.817874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:15.818609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:15.819069 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:15.819499 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:15.984614 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:15.992908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5b34fb23-9bd4-433b-b7b8-ee68274e98c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.187916 Oct 04 10:37:15.993452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 132/273] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:15 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:16.099837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:16.100600 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:16.107857 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:16.108401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:16.108775 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:16.109499 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:16.109953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:16.110381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:16.276613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:16.284710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:16.286182 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:16.287336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c3108ffb-2295-4312-a210-fa8799d8631f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.192147 Oct 04 10:37:16.287892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 142/274] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:16 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:16.327844 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-12eb4021-4c82-487f-9481-3417d1a5e411 req-7d6c2c86-f9df-47b1-a040-b9f2971e43ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4069cc0-c304-4868-b731-29e1becb18bd", "tag": "9eba00f5-4349-4c7c-900c-29adad777ee3"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:16.337844 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-12eb4021-4c82-487f-9481-3417d1a5e411 req-7d6c2c86-f9df-47b1-a040-b9f2971e43ad service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:16.338589 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-12eb4021-4c82-487f-9481-3417d1a5e411 req-7d6c2c86-f9df-47b1-a040-b9f2971e43ad service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:16.339483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-12eb4021-4c82-487f-9481-3417d1a5e411 req-7d6c2c86-f9df-47b1-a040-b9f2971e43ad service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:16.352238 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-12eb4021-4c82-487f-9481-3417d1a5e411 req-7d6c2c86-f9df-47b1-a040-b9f2971e43ad service nova] Creating event network-changed:9eba00f5-4349-4c7c-900c-29adad777ee3 for instance c4069cc0-c304-4868-b731-29e1becb18bd on hv-cinder-85919 Oct 04 10:37:16.357935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-12eb4021-4c82-487f-9481-3417d1a5e411 req-7d6c2c86-f9df-47b1-a040-b9f2971e43ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033092 Oct 04 10:37:16.358528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 133/275] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:37:16.785877 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:16.786497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:16.794023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:16.794517 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:16.795008 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:16.795708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:16.796166 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:16.799128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:16.930821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:16.938512 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a4bb66e5-9c2b-4b51-9b87-69af900b3c5b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.156384 Oct 04 10:37:16.939100 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 143/276] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:16 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:17.019305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:17.019937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:17.027096 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:17.027612 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:17.028218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:17.029395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:17.029856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:17.030287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:17.179014 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:17.187199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-03fb12ee-7ff8-42f1-8000-499f38f36b39 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.172837 Oct 04 10:37:17.187763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 134/277] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:17 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:17.312323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:17.312880 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:17.314710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:17.319472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:17.319958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:17.320396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:17.321113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:17.321564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:17.321993 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:17.457463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:17.468325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:17.470167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:17.471696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-596b19f3-bb25-4dfc-8a0a-f523e8980f49 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.163209 Oct 04 10:37:17.472609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 144/278] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:17 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:17.961073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:17.961760 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:17.966172 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:17.969978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:17.970526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:17.971029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:17.971720 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:17.972180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:17.972665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:18.128529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:18.148533 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-10664ba1-a73b-4960-84f2-63e74055dd64 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.191813 Oct 04 10:37:18.149154 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 135/279] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:17 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:18.210668 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:18.211323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:18.219059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:18.219663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:18.220100 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:18.220796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:18.221279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:18.221729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:18.355777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:18.364174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7e059a1a-cbc4-416b-a762-67574aa7d29e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.157628 Oct 04 10:37:18.377211 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 145/280] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:18 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:18.500133 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:18.500765 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:18.512409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:18.512965 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:18.513416 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:18.517601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:18.518415 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:18.519375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:19.063170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:19.071968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:19.074008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:19.075172 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-56b0dc40-10fd-4de4-b97b-f21027a52594 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.580602 Oct 04 10:37:19.075747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 136/281] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:18 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:19.173478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:19.174338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:19.176429 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=8 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:19.186103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:19.186845 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:19.187278 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:19.188298 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:19.188755 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:19.189400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:19.334085 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:19.343257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-899fa1a7-1507-46ca-894d-542e3cb76200 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.173740 Oct 04 10:37:19.343831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 146/282] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:19 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:19.387722 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:19.388331 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:19.394396 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:19.394879 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:19.395316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:19.396009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:19.396464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:19.396943 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:19.600131 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:19.608724 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c4a91e08-9009-4a10-818e-2b5e6ca0d632 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.225053 Oct 04 10:37:19.611452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 137/283] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:19 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:20.101260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:20.101858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:20.108470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:20.108984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:20.109488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:20.110177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:20.110629 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:20.111049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:20.266544 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:20.275722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:20.277514 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:20.278713 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3d1e0df1-6ced-420e-a27b-270e65b7e3e7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.181594 Oct 04 10:37:20.279263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 147/284] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:20 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:20.372836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:20.373732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:20.380196 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:20.380623 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:20.381098 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:20.381782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:20.382233 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:20.382658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:20.512772 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:20.520530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-82e1b56a-ea29-4c1a-a921-9bbc2156cee6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.152284 Oct 04 10:37:20.521117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 138/285] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:20 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:20.640338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:20.640338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:20.641194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:20.641674 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:20.642140 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:20.642831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:20.643283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:20.643709 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:20.793100 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:20.801192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-232ba89e-7646-4ad0-8a4b-2627104735ff tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1510 microversion: 2.1 time: 0.170943 Oct 04 10:37:20.801770 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 148/286] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:20 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:21.316682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:21.317318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:21.324032 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:21.324813 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:21.325299 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:21.325997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:21.326455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:21.326878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:21.471144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:21.479679 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:21.481751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:21.483048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-849dc142-1fb1-4422-af1f-d495561342a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.170075 Oct 04 10:37:21.483494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 139/287] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:21 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:21.549177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:21.549710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:21.556714 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:21.557376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:21.557868 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:21.558725 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:21.559188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:21.559612 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:21.696799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:21.704453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-26fdeaa8-d182-4486-90e9-f329896d8b94 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.159243 Oct 04 10:37:21.705038 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 149/288] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:21 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:21.829915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:21.830432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:21.836968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:21.837459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:21.837898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:21.838598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:21.839055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:21.839483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:21.969622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:21.977462 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d877d3fe-d5e1-4c01-af54-a527898a2a0f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1516 microversion: 2.1 time: 0.151576 Oct 04 10:37:21.978076 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 140/289] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:21 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:22.508992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:22.509608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:22.516440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:22.516966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:22.517513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:22.518081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:22.518532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:22.518984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:22.687481 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:22.695790 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:22.697293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:22.698491 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cd6d30a5-ec47-469a-82a8-d7f64fe4ccb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.194318 Oct 04 10:37:22.699092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 150/290] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:22 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:22.729299 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:22.729811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:22.737044 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:22.739920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:22.739920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:22.739920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:22.739920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:22.740366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:22.885131 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:22.893482 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bad85038-cb73-4ba9-8cb8-2524084e01b7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.168034 Oct 04 10:37:22.894063 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 141/291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:22 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:23.717290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5c420128-1423-458c-900b-c95ba4480757 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'create', calling method: .version_select at 0x7f9be9727d30>, body: {"keypair": {"name": "tempest-keypair-1402385389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4qIHd3W6LIhKWM5J9B7y6zzXL4QpJilV7wrFNQnthvxTcxVb//akREJa08h/1NF1zhSu/uKCqH65ycM2uO2q8t2FeB97AGYnksJ98MP7U3OUN5i3mKaoAAOjp1XAjIlA=="}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:23.723527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:23.724181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:23.730446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:23.730962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:23.731401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:23.737798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:23.737798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:23.737798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:23.738219 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-5c420128-1423-458c-900b-c95ba4480757 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:37:23.742111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-5c420128-1423-458c-900b-c95ba4480757 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for user c4f4844eb5e14d789476cfb44e2516f0 and project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:37:23.752084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:23.864471 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:23.871990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5c420128-1423-458c-900b-c95ba4480757 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158809 Oct 04 10:37:23.872594 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 151/292] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:37:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:23.875477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:23.876496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:23.877716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2da54ba4-d190-4c2c-9d62-6233c9e309af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.158137 Oct 04 10:37:23.878293 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 142/293] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:23 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:23.918314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:23.918924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:23.924851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:23.925358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:23.925793 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:23.926533 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:23.926927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:23.927347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:24.062252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:24.069890 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b1e9ea28-f7bc-4781-af74-011b5f78ff23 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.155865 Oct 04 10:37:24.070449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 152/294] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:23 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:24.904970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:24.906166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:24.914815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:24.915294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:24.915749 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:24.916431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:24.916895 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:24.917322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:25.094860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:25.095473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:25.103127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:25.103818 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:25.104191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:25.104912 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:25.105999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:25.106428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:25.109729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:25.119036 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:25.120506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:25.121741 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-96b83d32-a686-4df3-9990-47d2ff2e963d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1744 microversion: 2.20 time: 0.221260 Oct 04 10:37:25.122305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 143/295] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:24 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:25.242322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:25.250309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a74826aa-8754-49eb-a465-d3f2182eeb87 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.161297 Oct 04 10:37:25.250789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 153/296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:25 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:25.690411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d13a6a00-1268-4a81-9fe1-7d715a718706 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:25.696833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d13a6a00-1268-4a81-9fe1-7d715a718706 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:25.697417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d13a6a00-1268-4a81-9fe1-7d715a718706 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:25.698271 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d13a6a00-1268-4a81-9fe1-7d715a718706 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:25.765094 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d13a6a00-1268-4a81-9fe1-7d715a718706 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Going to try to stop instance {{(pid=127627) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 10:37:26.028313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d13a6a00-1268-4a81-9fe1-7d715a718706 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action" status: 202 len: 0 microversion: 2.1 time: 0.342245 Oct 04 10:37:26.028976 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 144/297] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:37:25 2022] POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:37:26.037696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:26.038400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:26.044599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:26.045126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:26.045565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:26.046249 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:26.046699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:26.047114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:26.148074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:26.148784 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:26.159484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:26.162402 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:26.162883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:26.163834 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:26.164463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:26.164919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:26.197889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:26.207223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-444de2dd-1e2f-4dc0-8301-e80c29583de7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.173361 Oct 04 10:37:26.207796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 154/298] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:26 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:26.278005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:26.278725 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:26.285220 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:26.285701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:26.286126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:26.287003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:26.287447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:26.288092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:26.336600 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:26.344923 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:26.346365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:26.347519 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-11b10ea8-2185-451f-8ace-ae3841595d5a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1744 microversion: 2.20 time: 0.203996 Oct 04 10:37:26.353003 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 145/299] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:26 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:26.465851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:26.475336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c4494aa9-5507-4e3c-8ccc-586252751897 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.204593 Oct 04 10:37:26.476266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 155/300] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:26 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:26.786102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-dbf9d6ab-eaa7-4936-b742-bea45aa7ced4 req-66324a8b-8816-4548-8ecd-5df2b03a8f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4069cc0-c304-4868-b731-29e1becb18bd", "name": "network-vif-plugged", "status": "completed", "tag": "9eba00f5-4349-4c7c-900c-29adad777ee3"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:26.798749 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-dbf9d6ab-eaa7-4936-b742-bea45aa7ced4 req-66324a8b-8816-4548-8ecd-5df2b03a8f33 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:26.799597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-dbf9d6ab-eaa7-4936-b742-bea45aa7ced4 req-66324a8b-8816-4548-8ecd-5df2b03a8f33 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:26.800362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-dbf9d6ab-eaa7-4936-b742-bea45aa7ced4 req-66324a8b-8816-4548-8ecd-5df2b03a8f33 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:26.813976 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-dbf9d6ab-eaa7-4936-b742-bea45aa7ced4 req-66324a8b-8816-4548-8ecd-5df2b03a8f33 service nova] Creating event network-vif-plugged:9eba00f5-4349-4c7c-900c-29adad777ee3 for instance c4069cc0-c304-4868-b731-29e1becb18bd on hv-cinder-85919 Oct 04 10:37:26.819240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-dbf9d6ab-eaa7-4936-b742-bea45aa7ced4 req-66324a8b-8816-4548-8ecd-5df2b03a8f33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037101 Oct 04 10:37:26.820025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 146/301] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:26.875093 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1170825018", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63e2f114-1421-4ab0-8fd6-833187dffa8d"}], "security_groups": [{"name": "tempest-securitygroup--80342689"}], "key_name": "tempest-keypair-1402385389", "user_data": "}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:26.989488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] validate_networks() for [('63e2f114-1421-4ab0-8fd6-833187dffa8d', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:37:27.237670 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:27.238314 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:27.244464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.244978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.245417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.247355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.247820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.248618 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.421281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:37:27.422799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:37:27.423358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:37:27.423943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:37:27.424516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:37:27.435780 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.436277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.436721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.437524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.438144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.438578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.455248 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:27.456689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:37:27.461338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Getting quotas for user c4f4844eb5e14d789476cfb44e2516f0 and project e94e5705bcfd476e87b2fa0af6ff597a. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:37:27.465278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e8702447-437c-46e6-b6c3-b9e29eacae01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.231894 Oct 04 10:37:27.465613 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 147/302] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:27 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:27.470147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:27.470750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:27.476427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.476945 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.477426 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.478109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.478770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.479196 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.483143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:37:27.485535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:37:27.611062 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:27.620370 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:27.622042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:27.623241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9060df37-a654-4f91-9727-5f47f0e796ab tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.156609 Oct 04 10:37:27.623794 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 148/303] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:27 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:27.629474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:27.630128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:27.636431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.636948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.637385 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.638114 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:27.638574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:27.640160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:27.646357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-093af8ca-89da-41c6-9bc8-99eec3e23d48 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.776067 Oct 04 10:37:27.647401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 156/304] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:37:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:37:27.659886 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-521d0234-b248-424e-9a2a-72033a795f08 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:27.660500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-521d0234-b248-424e-9a2a-72033a795f08 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:27.670371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:27.729964 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-521d0234-b248-424e-9a2a-72033a795f08 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:27.738610 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-521d0234-b248-424e-9a2a-72033a795f08 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1246 microversion: 2.1 time: 0.083749 Oct 04 10:37:27.739377 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 157/305] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:27 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:27.783146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:27.791188 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3ec0cf2b-546c-4ee7-98b2-eb3bcac53575 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.166437 Oct 04 10:37:27.791750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 149/306] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:27 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:28.488698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:28.489412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:28.498430 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:28.499026 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:28.499565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:28.508143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:28.508143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:28.508143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:28.649372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:28.649994 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:28.658083 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:28.659606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:28.660126 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:28.660989 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:28.661902 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:28.662367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:28.662800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:28.680689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-937a00ef-8a4f-4644-a99a-59db1c4e4a57 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.195701 Oct 04 10:37:28.690382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 158/307] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:28 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:28.762775 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-569dbec4-cafb-42ad-9885-e96e9d395258 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:28.763346 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-569dbec4-cafb-42ad-9885-e96e9d395258 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:28.841711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-569dbec4-cafb-42ad-9885-e96e9d395258 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:28.849895 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-569dbec4-cafb-42ad-9885-e96e9d395258 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1246 microversion: 2.1 time: 0.091722 Oct 04 10:37:28.855853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 159/308] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:28 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:28.856946 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:28.857719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:28.864062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:28.864710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:28.865319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:28.866308 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:28.866967 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:28.867532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:28.955335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:28.972558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:28.974134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:28.975330 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7d19db83-f8e4-4bbb-9f2a-71ea87f21ece tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.330541 Oct 04 10:37:28.984823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 150/309] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:28 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:29.004585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-b28b1359-9cad-4bc5-9597-620e8be3ed0a req-eb4ea19f-ad2a-4648-a002-f93d830dd839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d9120a-9e5e-47d3-9c56-10fe47d51d0f", "name": "network-vif-plugged", "status": "completed", "tag": "8a351264-c070-4d96-83c2-fbab580295f1"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:29.017180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-b28b1359-9cad-4bc5-9597-620e8be3ed0a req-eb4ea19f-ad2a-4648-a002-f93d830dd839 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:29.017830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-b28b1359-9cad-4bc5-9597-620e8be3ed0a req-eb4ea19f-ad2a-4648-a002-f93d830dd839 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:29.023584 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-b28b1359-9cad-4bc5-9597-620e8be3ed0a req-eb4ea19f-ad2a-4648-a002-f93d830dd839 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:29.032351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-b28b1359-9cad-4bc5-9597-620e8be3ed0a req-eb4ea19f-ad2a-4648-a002-f93d830dd839 service nova] Creating event network-vif-plugged:8a351264-c070-4d96-83c2-fbab580295f1 for instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f on hv-cinder-85919 Oct 04 10:37:29.039533 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-b28b1359-9cad-4bc5-9597-620e8be3ed0a req-eb4ea19f-ad2a-4648-a002-f93d830dd839 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052824 Oct 04 10:37:29.043930 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 151/310] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:29.072853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:29.077885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:29.087707 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1e2afbec-4ad9-4803-9372-14aaa55c38b9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1367 microversion: 2.1 time: 0.235338 Oct 04 10:37:29.108962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 160/311] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:28 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:29.708608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:29.709534 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:29.717779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:29.718484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:29.719084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:29.719786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:29.720238 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:29.720699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:29.876981 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:29.878363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:29.885048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:29.885838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:29.886257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:29.886772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:29.887484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:29.888096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:29.888372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:29.899020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2dda1636-1e0f-4579-8f4e-fc5905d07c2c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.194977 Oct 04 10:37:29.900179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 152/312] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:29 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:29.955405 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:29.966007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-15215fa9-141f-4af2-82f0-e4190b9b968a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1242 microversion: 2.1 time: 0.095926 Oct 04 10:37:29.976881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 161/313] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:29 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:30.007176 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:30.007782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:30.017717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.018233 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.018999 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:30.019519 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.019967 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.020455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:30.116218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:30.117121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:30.124339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.126368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.126368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:30.126795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.127601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.128184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:30.189656 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:30.200216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:30.202595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:30.205195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-eb86eef8-cebd-474f-9bf3-5716396a1086 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.202109 Oct 04 10:37:30.206534 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 153/314] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:30 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:30.364328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:30.377023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4d9d54e4-f880-43f8-b1f2-e4d509a2b2b1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1557 microversion: 2.1 time: 0.263240 Oct 04 10:37:30.377023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 162/315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:30 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:30.400828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:30.401535 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:30.408355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.408837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.409500 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:30.410191 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.410644 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.411064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:30.520695 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1e8da55f-fdea-409f-88c0-5471ad02a7cd tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126635 Oct 04 10:37:30.521353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 154/316] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:37:30 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:30.924495 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:30.925144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:30.931285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.931774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.932223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:30.935427 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:30.940588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:30.944669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:31.032474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:31.032474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:31.032474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:31.032474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:31.043436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:31.043436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:31.043436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:31.043436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:31.206383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:31.215636 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b2826754-4edc-485c-ba9e-5d6aa455b46f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1298 microversion: 2.1 time: 0.209132 Oct 04 10:37:31.216841 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 155/317] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:31 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:31.248352 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:31.249143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:31.260542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:31.260542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:31.260542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:31.260881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:31.261008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:31.261008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:31.261008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:31.283947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3c15f1a8-3208-4c96-8ba7-614660b8f1f8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.362342 Oct 04 10:37:31.302655 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 163/318] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:30 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:31.547980 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:31.562350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:31.565034 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:31.566557 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-79dcdfce-f7ad-4ce7-863a-fd66b6864edd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.329690 Oct 04 10:37:31.567261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 156/319] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:31 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:32.056505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-ec3f9e79-7df1-4f3a-a4ba-b6942da36e5f req-890add73-f3a9-409e-ba26-ba526e680176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4069cc0-c304-4868-b731-29e1becb18bd", "tag": "9eba00f5-4349-4c7c-900c-29adad777ee3"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:32.069032 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ec3f9e79-7df1-4f3a-a4ba-b6942da36e5f req-890add73-f3a9-409e-ba26-ba526e680176 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:32.069509 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ec3f9e79-7df1-4f3a-a4ba-b6942da36e5f req-890add73-f3a9-409e-ba26-ba526e680176 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:32.069931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ec3f9e79-7df1-4f3a-a4ba-b6942da36e5f req-890add73-f3a9-409e-ba26-ba526e680176 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:32.084227 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-ec3f9e79-7df1-4f3a-a4ba-b6942da36e5f req-890add73-f3a9-409e-ba26-ba526e680176 service nova] Creating event network-changed:9eba00f5-4349-4c7c-900c-29adad777ee3 for instance c4069cc0-c304-4868-b731-29e1becb18bd on hv-cinder-85919 Oct 04 10:37:32.092494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-ec3f9e79-7df1-4f3a-a4ba-b6942da36e5f req-890add73-f3a9-409e-ba26-ba526e680176 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039414 Oct 04 10:37:32.095023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 164/320] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:32.239538 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:32.240256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:32.248224 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:32.248760 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:32.249307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:32.250011 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:32.250467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:32.250895 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:32.313317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:32.314026 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:32.316595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:32.322216 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:32.323067 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:32.323890 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:32.325209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:32.325710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:32.326215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:32.327135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-594b8559-0fa1-469f-a095-d2822d51238a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1316 microversion: 2.1 time: 0.091309 Oct 04 10:37:32.327902 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 157/321] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:32 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:32.475133 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:32.482218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9c721497-99da-4202-8723-635a7b0504f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.174386 Oct 04 10:37:32.482787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 165/322] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:32 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:32.592841 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:32.593448 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:32.609324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:32.610428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:32.611078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:32.612161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:32.612848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:32.613507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:32.789982 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:32.799809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:32.802206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:32.804074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-14b4f958-3d05-4a08-8e25-f90395b7df16 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.215018 Oct 04 10:37:32.806777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 158/323] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:32 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:33.351443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:33.352751 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:33.360021 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:33.360719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:33.361376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:33.362318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:33.362915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:33.363489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:33.434144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:33.443322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-debcd588-f183-4b6f-9b86-ffda423d7e43 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1304 microversion: 2.1 time: 0.095690 Oct 04 10:37:33.444823 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 166/324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:33 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:33.516766 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:33.517430 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:33.528738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:33.529313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:33.529763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:33.530583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:33.531046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:33.531737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:33.687855 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:33.695228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:33.698087 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-07169b7e-7f7c-430c-a77e-7fdb6255ba80 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.192808 Oct 04 10:37:33.715715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 159/325] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:33 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:33.831710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:33.832365 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:33.839032 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:33.839461 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:33.839896 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:33.840587 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:33.841061 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:33.841483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:33.985634 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:33.994516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:33.996815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:33.998181 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-da2ffaf9-89a8-4980-92e0-21368927b4d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.170405 Oct 04 10:37:33.998830 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 167/326] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:33 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:34.467909 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:34.469361 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:34.475491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:34.476003 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:34.476424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:34.477428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:34.477682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:34.478171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:34.723504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:34.724118 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:34.730637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:34.731423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:34.732052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:34.732943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:34.733542 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:34.734113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:34.850706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:34.861225 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-de2ba18e-54a4-4610-bcdd-af69f7c920f8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1304 microversion: 2.1 time: 0.396855 Oct 04 10:37:34.862170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 160/327] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:34 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1304 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:34.893331 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:34.901866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4a2948c3-160c-4d41-a6a7-a997648f7270 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.182272 Oct 04 10:37:34.906463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 168/328] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:34 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:35.025106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:35.025721 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:35.036367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:35.036890 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:35.037335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:35.038483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:35.038950 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:35.040080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:35.364169 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:35.377037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:35.377037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:35.380478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8465f83f-e7f1-4c2a-bb37-a2241011d492 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.358083 Oct 04 10:37:35.380478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 161/329] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:35 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:35.884430 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:35.885076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:35.892757 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:35.893275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:35.893712 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:35.894410 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:35.894862 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:35.895290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:35.931628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:35.933481 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:35.940484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:35.940928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:35.941364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:35.942057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:35.942506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:35.942926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:36.061121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:36.068989 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-96108a4c-7a20-47fd-b9f4-6eb0ed69c3dc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.188379 Oct 04 10:37:36.069655 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 169/330] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:35 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:36.080281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:36.088919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f64487c8-aa1e-4ee5-8197-db7775829976 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.162585 Oct 04 10:37:36.089792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 162/331] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:35 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:36.413341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:36.414136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:36.427352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:36.427851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:36.429015 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:36.429901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:36.430502 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:36.431072 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:36.751300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:36.763880 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:36.766509 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:36.768276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-adc42f1e-c5f7-4794-bdb2-43c09a34bbfc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.366554 Oct 04 10:37:36.775252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 170/332] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:36 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:37.097622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:37.099145 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:37.119093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:37.119093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:37.119093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:37.119093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:37.119419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:37.119419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:37.119595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:37.119595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:37.124806 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:37.126053 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:37.126495 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:37.127367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:37.128464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:37.129101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:37.291660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:37.301474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5a87cadf-a715-4917-914f-40347844d142 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.208381 Oct 04 10:37:37.302439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:37.320785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2f049514-e926-4c59-8cfd-05ff059abf83 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.208929 Oct 04 10:37:37.321393 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 171/334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:37 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:37.324478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 163/334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:37 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:37.392996 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-5e6781d4-a9c5-4cc1-a5fb-101319bdf5ca req-462834fa-c989-4e7e-974d-6a25a5e81f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2d2b30-9c51-470d-aa3b-edc245fff08b", "tag": "ec90e50c-fd6d-48b5-87e0-0ad3457c78dc"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:37.406552 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5e6781d4-a9c5-4cc1-a5fb-101319bdf5ca req-462834fa-c989-4e7e-974d-6a25a5e81f3c service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:37.407379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5e6781d4-a9c5-4cc1-a5fb-101319bdf5ca req-462834fa-c989-4e7e-974d-6a25a5e81f3c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:37.408053 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5e6781d4-a9c5-4cc1-a5fb-101319bdf5ca req-462834fa-c989-4e7e-974d-6a25a5e81f3c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:37.420294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-5e6781d4-a9c5-4cc1-a5fb-101319bdf5ca req-462834fa-c989-4e7e-974d-6a25a5e81f3c service nova] Creating event network-changed:ec90e50c-fd6d-48b5-87e0-0ad3457c78dc for instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b on hv-cinder-85919 Oct 04 10:37:37.427370 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-5e6781d4-a9c5-4cc1-a5fb-101319bdf5ca req-462834fa-c989-4e7e-974d-6a25a5e81f3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039579 Oct 04 10:37:37.427990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 172/335] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:37.795294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:37.795946 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:37.803436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:37.804043 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:37.813456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:37.813456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:37.813456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:37.813456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:38.118757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:38.157111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:38.157111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:38.157111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9db1f148-c34e-4841-820f-3ed09da24a10 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.358650 Oct 04 10:37:38.157423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 164/336] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:37 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:38.328325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:38.333522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:38.338063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:38.342314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:38.343081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:38.343706 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:38.344599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:38.345236 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:38.345814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:38.353768 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:38.358281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:38.372157 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:38.372965 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:38.373555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:38.380891 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:38.386894 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:38.386894 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:38.564129 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:38.579217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e5e781c4-6ceb-43b6-8935-b91e54bbe139 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.251553 Oct 04 10:37:38.579422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:38.580853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 173/337] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:38 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:38.589820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e7b181d1-7719-4989-9589-6ddc5678a89b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.239332 Oct 04 10:37:38.590393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 165/338] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:38 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:39.177288 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:39.177838 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:39.181445 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=14 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:39.194861 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:39.195618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:39.196170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:39.197279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:39.199337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:39.205440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:39.369351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:39.379349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:39.381087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:39.382257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4287f8d3-3e48-4ab8-89ca-63f2fed5fb6e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.209438 Oct 04 10:37:39.383122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 174/339] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:39 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:39.636364 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:39.637255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:39.638513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:39.639342 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:39.655696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:39.658837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:39.658837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:39.658837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:39.658837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:39.659212 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:39.659296 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:39.659394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:39.659773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:39.660676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:39.661318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:39.662026 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:39.848296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:39.849399 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:39.859403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-77a851d3-a626-4753-999c-b38c0d1e3786 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.236245 Oct 04 10:37:39.860258 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 175/340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:39 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:39.860838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6a722d07-7f90-4319-b6b0-86bf28d4ca2f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.254791 Oct 04 10:37:39.861784 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 166/341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:39 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:40.409230 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:40.409230 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:40.416345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:40.416765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:40.417327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:40.418268 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:40.419399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:40.419952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:40.607613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:40.616415 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:40.618152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:40.619471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-74eb835b-a461-43f4-95a5-3fc3e519b397 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.215610 Oct 04 10:37:40.634524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 176/342] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:40 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:40.884270 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:40.885527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:40.886984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:40.887476 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:40.898393 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:40.899310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:40.899849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:40.900833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:40.901692 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:40.902885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:40.907167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=92 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:40.908617 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:40.914633 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:40.915932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:40.916986 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:40.922113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:40.922113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:41.089319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:41.100612 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cc904506-05a8-4a61-b61b-df1d8fdeaa73 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.217843 Oct 04 10:37:41.114459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 177/343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:40 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:41.143201 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:41.174582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-614afdc8-f095-47cc-bf83-8736d0507673 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.294960 Oct 04 10:37:41.175165 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 167/344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:40 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:41.652740 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:41.657546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:41.664993 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:41.665675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:41.666119 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:41.668935 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:41.668935 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:41.668935 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:41.841544 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:41.844724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:41.852372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:41.853840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:41.854987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cef3568d-9b7c-42a3-a86b-1b81915acaa3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1739 microversion: 2.20 time: 0.208870 Oct 04 10:37:41.856298 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 178/345] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:41 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:42.125580 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:42.126195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:42.133068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:42.133595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:42.134030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:42.134770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:42.135222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:42.135649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:42.201660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:42.201919 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:42.208713 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:42.209633 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:42.210111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:42.210858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:42.211271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:42.211872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:42.280540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:42.288936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa123f4c-58f1-4b5c-9a44-f1286e2c19fc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.167259 Oct 04 10:37:42.304715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 168/346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:42 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:42.361172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:42.369636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a49efefe-5447-48f3-a58b-73d9851791c9 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.174337 Oct 04 10:37:42.385081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 179/347] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:42 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:42.821224 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-23b70035-dd4a-428f-8ad2-35fc5885f28d req-9abbafe7-faba-44d6-85e0-420be225572b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2d2b30-9c51-470d-aa3b-edc245fff08b", "name": "network-vif-plugged", "status": "completed", "tag": "ec90e50c-fd6d-48b5-87e0-0ad3457c78dc"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:42.832237 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-23b70035-dd4a-428f-8ad2-35fc5885f28d req-9abbafe7-faba-44d6-85e0-420be225572b service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:42.832883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-23b70035-dd4a-428f-8ad2-35fc5885f28d req-9abbafe7-faba-44d6-85e0-420be225572b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:42.833322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-23b70035-dd4a-428f-8ad2-35fc5885f28d req-9abbafe7-faba-44d6-85e0-420be225572b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:42.845267 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-23b70035-dd4a-428f-8ad2-35fc5885f28d req-9abbafe7-faba-44d6-85e0-420be225572b service nova] Creating event network-vif-plugged:ec90e50c-fd6d-48b5-87e0-0ad3457c78dc for instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b on hv-cinder-85919 Oct 04 10:37:42.850214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-23b70035-dd4a-428f-8ad2-35fc5885f28d req-9abbafe7-faba-44d6-85e0-420be225572b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Oct 04 10:37:42.850914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 169/348] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:42.881613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:42.882219 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:42.888762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:42.889284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:42.889889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:42.891219 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:42.891672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:42.892464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:43.035824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:43.045172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:43.046622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:43.049983 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-16fc05a5-424e-49e0-bce5-365d646627c0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1721 microversion: 2.20 time: 0.170071 Oct 04 10:37:43.049983 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 180/349] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:42 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:43.313368 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:43.314793 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:43.324487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:43.325219 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:43.325693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:43.326402 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:43.326997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:43.327613 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:43.395102 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:43.395823 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:43.404774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:43.404774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:43.404774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:43.410776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:43.410776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:43.410776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:43.531408 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:43.539348 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c534f4db-aef0-47fb-afc6-228782022625 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.231431 Oct 04 10:37:43.539913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 170/350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:43 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:43.550894 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:43.560400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6103619d-f4c1-4851-88b4-a51111f40d51 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.170116 Oct 04 10:37:43.561014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 181/351] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:43 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:44.073432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:44.074064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:44.081088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:44.081606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:44.082049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:44.082735 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:44.083308 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:44.083776 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:44.215431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:44.223704 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:44.225196 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:44.226351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-abaf9e5b-27c9-4e29-8c22-d39133419809 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1721 microversion: 2.20 time: 0.157030 Oct 04 10:37:44.226907 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 171/352] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:44 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:44.562218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:44.562868 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:44.569582 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:44.570109 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:44.570545 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:44.571243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:44.571726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:44.572122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:44.589195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:44.589874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:44.596591 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:44.597095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:44.597525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:44.598208 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:44.598658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:44.599179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:44.729031 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:44.738249 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-073da8d9-9eb2-47e0-b4bf-76fc92a0b6e3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.180295 Oct 04 10:37:44.738596 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 182/353] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:44 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:44.746572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:44.754916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5f899d86-a7c4-4a3a-bc03-0c8de75a2d8b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.170095 Oct 04 10:37:44.755624 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 172/354] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:44 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:45.251520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:45.252134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:45.258799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:45.259290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:45.259729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:45.260530 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:45.260919 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:45.261711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:45.404698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:45.413005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:45.414465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:45.415608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-23eef434-08f5-4112-a037-88bf07ea2f25 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1721 microversion: 2.20 time: 0.167928 Oct 04 10:37:45.416301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 183/355] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:45 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:45.760692 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:45.761328 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:45.767987 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:45.768557 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:45.769574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:45.770281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:45.770737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:45.771164 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:45.782848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:45.783461 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:45.789832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:45.790310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:45.790917 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:45.791607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:45.792062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:45.792489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:45.922685 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:45.936212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-09397d36-ce59-4ded-9ac0-f1231394eddc tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1370 microversion: 2.1 time: 0.178536 Oct 04 10:37:45.937093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 173/356] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:45 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:45.955830 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:45.964130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-81f8635f-7da9-4cb1-8bf2-9e3f39a8231e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.185606 Oct 04 10:37:45.964681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 184/357] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:45 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:46.440559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:46.441091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:46.446957 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:46.447451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:46.447884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:46.448571 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:46.449051 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:46.449475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:46.524174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-0549a956-e775-4fe7-a66d-9f4efa5dd5f4 req-fb1217c0-55db-4d57-a2f0-47cc1595dd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d9120a-9e5e-47d3-9c56-10fe47d51d0f", "name": "network-vif-unplugged", "status": "completed", "tag": "8a351264-c070-4d96-83c2-fbab580295f1"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:46.536172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0549a956-e775-4fe7-a66d-9f4efa5dd5f4 req-fb1217c0-55db-4d57-a2f0-47cc1595dd59 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:46.536708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0549a956-e775-4fe7-a66d-9f4efa5dd5f4 req-fb1217c0-55db-4d57-a2f0-47cc1595dd59 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:46.537189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0549a956-e775-4fe7-a66d-9f4efa5dd5f4 req-fb1217c0-55db-4d57-a2f0-47cc1595dd59 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:46.548881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-0549a956-e775-4fe7-a66d-9f4efa5dd5f4 req-fb1217c0-55db-4d57-a2f0-47cc1595dd59 service nova] Creating event network-vif-unplugged:8a351264-c070-4d96-83c2-fbab580295f1 for instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f on hv-cinder-85919 Oct 04 10:37:46.554466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-0549a956-e775-4fe7-a66d-9f4efa5dd5f4 req-fb1217c0-55db-4d57-a2f0-47cc1595dd59 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034313 Oct 04 10:37:46.555302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 185/358] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:37:46.587498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:46.597428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:46.599093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:46.600243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-23742360-d606-48f0-8db7-6d790791cf22 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1724 microversion: 2.20 time: 0.163591 Oct 04 10:37:46.600787 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 174/359] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:46 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:46.627588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "428d7042-0c92-488b-967f-f1e73dbac8f6"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:46.631183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:46.636496 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:46.637002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:46.637983 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:46.639194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:46.639648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:46.640074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:46.959681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:46.960200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:46.967796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:46.968322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:46.968763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:46.969565 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:46.970001 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:46.970429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:47.124397 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:47.132290 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-669f59b4-1607-4e72-a35a-788618ec4d33 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1564 microversion: 2.1 time: 0.176773 Oct 04 10:37:47.132850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 175/360] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:46 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:47.138830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:47.139513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:47.145740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:47.146372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:47.146810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:47.147652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:47.148144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:47.148747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:47.279753 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:47.288095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1ef59a43-84d6-4ad1-a873-707d1ecf529f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.154077 Oct 04 10:37:47.288666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 176/361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:47 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:47.294181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:47.294867 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:47.301501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:47.302023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:47.302455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:47.303390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:47.303844 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:47.304417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:47.308464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:47.384467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5becb380-27af-49ea-9057-caec5e7f7c6c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094646 Oct 04 10:37:47.385291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 177/362] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:37:47 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:47.588725 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6a8a9edd-1588-4f50-9db6-ad43e595008d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.966155 Oct 04 10:37:47.589456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 186/363] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Oct 4 10:37:46 2022] POST /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments => generated 188 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:37:47.723798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:47.724406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:47.730407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:47.730960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:47.732436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:47.732949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:47.733434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:47.733862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:47.783450 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127627) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 10:37:48.140649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1e116435-73e5-4c86-8fb7-300ade9cdf01 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/action" status: 202 len: 0 microversion: 2.20 time: 0.421411 Oct 04 10:37:48.142048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 178/364] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 10:37:47 2022] POST /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:37:48.150582 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:48.151770 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:48.162042 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:48.162643 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:48.163339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:48.164367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:48.165181 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:48.165704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:48.313995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:48.314811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:48.321173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:48.321892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:48.322506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:48.323208 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:48.323829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:48.324407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:48.388945 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:48.400275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:48.402470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:48.404272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d344e599-ce22-4dd0-8f6c-4c50d15332d0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1750 microversion: 2.20 time: 0.257878 Oct 04 10:37:48.405153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 187/365] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:48 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:48.490343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:48.508151 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4db4f4a2-2d3c-4c27-ac1e-2f8584b3dca7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.198909 Oct 04 10:37:48.515351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 179/366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:48 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:48.581984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-799844ff-496a-4a4e-ac16-5ee702cf2a56 req-a3e1ea91-311b-4a39-b614-d0cecebd595f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2d2b30-9c51-470d-aa3b-edc245fff08b", "tag": "ec90e50c-fd6d-48b5-87e0-0ad3457c78dc"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:37:48.592224 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-799844ff-496a-4a4e-ac16-5ee702cf2a56 req-a3e1ea91-311b-4a39-b614-d0cecebd595f service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:48.592838 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-799844ff-496a-4a4e-ac16-5ee702cf2a56 req-a3e1ea91-311b-4a39-b614-d0cecebd595f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:48.593211 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-799844ff-496a-4a4e-ac16-5ee702cf2a56 req-a3e1ea91-311b-4a39-b614-d0cecebd595f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:48.604428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-799844ff-496a-4a4e-ac16-5ee702cf2a56 req-a3e1ea91-311b-4a39-b614-d0cecebd595f service nova] Creating event network-changed:ec90e50c-fd6d-48b5-87e0-0ad3457c78dc for instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b on hv-cinder-85919 Oct 04 10:37:48.613770 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-799844ff-496a-4a4e-ac16-5ee702cf2a56 req-a3e1ea91-311b-4a39-b614-d0cecebd595f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Oct 04 10:37:48.613770 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 188/367] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:37:49.435125 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:49.435962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:49.443336 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:49.443822 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:49.444258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:49.444997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:49.445453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:49.445912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:49.535717 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:49.536526 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:49.543917 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:49.544666 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:49.545252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:49.545971 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:49.546652 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:49.547202 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:49.592144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:49.601921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:49.603380 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:49.604629 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6569f7b3-9cd4-49d2-b6d9-40e95f081e06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1750 microversion: 2.20 time: 0.173566 Oct 04 10:37:49.605398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 180/368] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:49 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:49.695008 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:49.704281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f1691278-f250-445f-947a-feabede3a605 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.174175 Oct 04 10:37:49.704876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 189/369] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:49 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:50.630643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:50.631245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:50.637789 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:50.638265 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:50.638994 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:50.639464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:50.639913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:50.640332 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:50.728834 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:50.729460 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:50.736577 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:50.737094 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:50.737528 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:50.738225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:50.738670 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:50.739087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:50.778628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:50.788074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:50.789525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:50.790669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b329cdf8-01da-4b07-825f-7adffe7ef391 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1750 microversion: 2.20 time: 0.164066 Oct 04 10:37:50.791216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 181/370] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:50 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:51.089791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:51.100754 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-68cd9cf5-847f-4f27-9530-cf2c4b2db838 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.375625 Oct 04 10:37:51.101580 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 190/371] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:50 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:51.817442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:51.818309 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:51.824634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:51.825143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:51.825575 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:51.826663 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:51.827115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:51.827594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:51.957433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:51.966253 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:51.968216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:51.970197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7c81c67c-0a37-4df0-81dd-440387d7f28e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1752 microversion: 2.20 time: 0.156879 Oct 04 10:37:51.970781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 182/372] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:51 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:52.126893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:52.127419 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:52.134011 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:52.134489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:52.134919 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:52.135602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:52.136046 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:52.136674 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:52.275608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:52.284095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-36bc0b77-f588-44df-864c-24a8c6637136 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.161616 Oct 04 10:37:52.284851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 191/373] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:52 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:53.011459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:53.012105 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:53.018717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:53.019198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:53.019640 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:53.020374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:53.020891 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:53.021268 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:53.154054 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:53.163174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:53.164627 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:53.165810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e37f8b20-5bab-4d21-a221-b9287dc87b35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1752 microversion: 2.20 time: 0.158244 Oct 04 10:37:53.166581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 183/374] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:53 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:53.307754 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:53.308358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:53.316212 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:53.316690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:53.317198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:53.317887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:53.318341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:53.318821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:53.455216 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:53.464585 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fcd0a221-0031-409b-9488-c24da1bea5ff tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.160816 Oct 04 10:37:53.465317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 192/375] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:53 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:54.192000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:54.192545 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:54.200227 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:54.201318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:54.201704 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:54.202424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:54.202881 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:54.203339 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:54.489828 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:54.490433 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:54.496809 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:54.497323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:54.498264 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:54.499039 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:54.499487 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:54.499906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:54.533933 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:54.543534 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:54.545866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:54.547431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-df05016c-48bc-47a5-9d45-38d82237e55c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.359496 Oct 04 10:37:54.548085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 184/376] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:54 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:54.635454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:54.644790 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-abebac7a-3aae-49be-ad5d-91124bd206af tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.158950 Oct 04 10:37:54.645775 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 193/377] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:54 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:55.579595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:55.581009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:55.590496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:55.591570 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:55.592646 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:55.593989 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:55.594768 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:55.595685 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:55.669646 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:55.671036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:55.676986 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:55.677726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:55.678378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:55.679175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:55.679732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:55.680252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:55.699599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:55.824521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:55.836907 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:55.839061 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:55.840595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-974bec79-0152-44df-8850-682e36e5da30 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.267874 Oct 04 10:37:55.842634 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:55.843610 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 185/378] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:55 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:55.868962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-812558d3-8d84-46f1-baa0-1d55974b8328 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.203631 Oct 04 10:37:55.870078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 194/379] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:55 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:56.869173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:56.870637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:56.880763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:56.881506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:56.882110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:56.883427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:56.884098 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:56.884818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:56.903001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:56.904503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:56.919209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:56.919789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:56.920233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:56.923705 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:56.924231 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:56.924668 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:57.089968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:57.099902 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2dd43939-c02b-4beb-aa16-9c1a63a1e9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.207876 Oct 04 10:37:57.102999 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:57.114994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 195/380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:56 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:37:57.122736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:57.129364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:57.130911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5a1cedc3-e706-4f1d-8ee7-18a71142b378 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.265596 Oct 04 10:37:57.132191 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 186/381] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:56 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:37:58.132530 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:58.132530 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:58.134085 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:58.134579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:58.135018 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:58.135730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:58.136182 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:58.136605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:58.158409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:58.159734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:58.170957 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:58.171796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:58.172458 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:58.173391 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:58.188909 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:58.189759 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:58.330489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:58.339810 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a775954d-a0dd-46e4-934f-faed90ea24be tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.217928 Oct 04 10:37:58.349835 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 196/382] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:58 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:58.388806 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:58.399140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:58.400597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:58.401780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa55c6cd-014a-4cc6-8dad-fecc7b555880 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.248519 Oct 04 10:37:58.402326 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 187/383] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:58 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:37:59.372390 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:59.373684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:59.376277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=82 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:59.384762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:59.384762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:59.384762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:59.384762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:59.387693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:59.388485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:59.430956 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:37:59.432168 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:37:59.443231 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:59.443854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:59.444396 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:59.445563 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:37:59.446129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:37:59.446783 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:37:59.607564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:59.630398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:59.637867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d53af59d-31e0-4463-8733-eb22672b6f01 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.266377 Oct 04 10:37:59.640333 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 197/384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:37:59 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:37:59.658940 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:59.660469 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:37:59.661888 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1a337364-2d44-4212-a74e-598b087495ef tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.237347 Oct 04 10:37:59.662713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 188/385] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:37:59 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:38:00.665770 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:00.666405 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:00.674324 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:00.674871 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:00.675505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:00.676275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:00.676738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:00.677243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:00.696456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:00.697226 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:00.704369 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:00.705351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:00.706030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:00.707084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:00.708553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:00.709378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:00.917133 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:00.926647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:00.929493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:00.938279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:00.938279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d12e5308-3e8d-44db-a417-e57d3c3b837d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.240523 Oct 04 10:38:00.938279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 189/386] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:00 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:00.938672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0d0a7b2d-81bc-4817-a15d-1a7790c190f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.273177 Oct 04 10:38:00.938672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 198/387] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:00 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:01.960573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:01.961201 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:01.961632 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:01.961722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:01.970906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:01.971161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:01.971393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:01.971610 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:01.972155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:01.973061 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:01.973511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:01.973933 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:01.981010 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:01.984073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:01.984745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:01.986337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:02.202393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:02.212524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:02.215213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:02.217997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-658f214c-2ac0-4f6b-9649-60db97068f80 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.262123 Oct 04 10:38:02.222899 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 190/388] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:01 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:02.229675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:02.243009 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e574e90a-02b7-46de-9d03-ead13a95e04e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.286872 Oct 04 10:38:02.244493 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 199/389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:01 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:03.250491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:03.251357 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:03.260744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:03.265029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:03.265496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:03.266333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:03.266795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:03.267405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:03.268465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:03.269291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:03.276138 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:03.277209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:03.277883 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:03.279501 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:03.280189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:03.280846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:03.472699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:03.473058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:03.482806 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b11ec305-95f3-4a3a-8475-129288995ce4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.217460 Oct 04 10:38:03.496885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 200/390] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:03 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:03.501519 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:03.502611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:03.503957 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fc65009b-eb82-4785-9ede-a2c424742ff4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.258204 Oct 04 10:38:03.504609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 191/391] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:03 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:04.513657 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:04.515242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:04.522673 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:04.523415 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:04.524155 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:04.527062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:04.527713 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:04.528141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:04.533829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:04.534664 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:04.550950 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:04.551603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:04.552152 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:04.553144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:04.553674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:04.554986 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:04.704356 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:04.713960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2af63a33-1b27-4f01-821f-e9a0d3677e37 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1724 microversion: 2.1 time: 0.207413 Oct 04 10:38:04.714541 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 201/392] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:04 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:04.758277 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:04.769166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:04.769166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:04.769869 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5664e265-8cdf-490e-92a8-5d0499b84c7e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.241695 Oct 04 10:38:04.770758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 192/393] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:04 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:05.738674 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:05.739288 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:05.745606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:05.746089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:05.746532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:05.747236 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:05.748202 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:05.748633 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:05.796335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:05.797599 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:05.806631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:05.807108 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:05.807546 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:05.808263 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:05.808707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:05.809151 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:05.813715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:05.893192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:05.901825 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-29484d98-32e2-4282-b9bd-feda51f3abd3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1701 microversion: 2.1 time: 0.166953 Oct 04 10:38:05.913349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 202/394] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:05 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:05.929234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eb5ec85c-40dd-4688-96a0-7955b3cda8f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:05.933271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb5ec85c-40dd-4688-96a0-7955b3cda8f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:05.933758 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb5ec85c-40dd-4688-96a0-7955b3cda8f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:05.934228 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb5ec85c-40dd-4688-96a0-7955b3cda8f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:05.965932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:05.976396 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:05.978158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:05.979316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6e649953-3e81-4bcb-bf75-2a1edfb2dc15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.187415 Oct 04 10:38:05.979854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 193/395] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:05 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:38:06.002538 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-eb5ec85c-40dd-4688-96a0-7955b3cda8f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Going to try to start instance {{(pid=127628) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 10:38:06.250525 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-eb5ec85c-40dd-4688-96a0-7955b3cda8f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action" status: 202 len: 0 microversion: 2.1 time: 0.328453 Oct 04 10:38:06.251044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 203/396] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:38:05 2022] POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:38:06.259408 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:06.260025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:06.268023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:06.268510 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:06.268973 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:06.269674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:06.270123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:06.270551 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:06.419946 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:06.428819 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-de9f5a2a-886c-4486-aca8-5d347ab4d2ad tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1710 microversion: 2.1 time: 0.173517 Oct 04 10:38:06.429635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 194/397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:06 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:07.007922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:07.008614 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:07.015595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:07.016111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:07.016603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:07.017341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:07.017792 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:07.018216 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:07.187185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:07.197551 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:07.200106 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:07.201659 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f1857a8e-ad94-4cc9-b725-a1eb85b9c92f tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.198586 Oct 04 10:38:07.202338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 204/398] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:07 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:07.454247 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:07.454901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:07.461365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:07.461851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:07.462290 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:07.462985 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:07.463439 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:07.463865 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:07.605317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:07.614432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-28725cd7-101b-4093-a174-0e7dea88eba1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1710 microversion: 2.1 time: 0.165623 Oct 04 10:38:07.615227 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 195/399] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:07 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:08.227644 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:08.228241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:08.235645 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:08.236056 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:08.236493 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:08.237237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:08.237761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:08.238178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:08.380157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:08.386305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:08.388325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:08.389637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-77607741-8685-4c87-bbed-be01e1525b4c tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.166019 Oct 04 10:38:08.390192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 205/400] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:08 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:08.638874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:08.639486 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:08.645440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:08.645926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:08.646367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:08.647081 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:08.647540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:08.647963 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:08.785432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:08.793609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-75615a22-45c2-452c-b9b4-e173ac7a1cac tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1714 microversion: 2.1 time: 0.159756 Oct 04 10:38:08.794820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 196/401] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:08 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:09.415647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:09.416461 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:09.423606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:09.424089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:09.424523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:09.425250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:09.425834 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:09.426255 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:09.594028 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:09.602807 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:09.604279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:09.605452 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e043c60e-a3bb-4081-9ad5-62126e7bec79 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.193816 Oct 04 10:38:09.606008 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 206/402] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:09 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:10.632548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:10.633170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:10.640291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:10.640773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:10.641243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:10.641930 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:10.642377 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:10.642798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:10.782415 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:10.791271 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:10.792739 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:10.794541 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3447df68-83bc-4f48-bb13-c95c52d39347 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.165195 Oct 04 10:38:10.795103 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 197/403] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:10 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:11.819351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:11.820470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:11.827921 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:11.828357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:11.828789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:11.829610 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:11.830060 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:11.830487 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:11.960609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:11.969573 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:11.971279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:11.972426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a2c8c77b-9666-4000-a08d-5301b9f43f18 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.156936 Oct 04 10:38:11.973011 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 207/404] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:11 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:13.000121 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:13.001095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:13.004174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:13.007480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:13.007960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:13.008398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:13.009135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:13.009563 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:13.009996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:13.141933 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:13.150346 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:13.151805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:13.152971 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-49b41b74-b347-466c-b920-5bfbd67cf269 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.158786 Oct 04 10:38:13.154309 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 198/405] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:12 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:14.180384 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:14.181026 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:14.188256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:14.188769 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:14.189244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:14.189933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:14.190383 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:14.190805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:14.324169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:14.333469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:14.335220 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:14.336422 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7b600f08-20ed-40f4-bb96-fac88490624d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.160044 Oct 04 10:38:14.337029 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 208/406] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:14 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:14.863184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-4b9e4e6f-fe2e-4e21-8e95-1ab1b3fee3b0 req-e3b056d8-98e8-4411-90e0-6f0b774ad827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d9120a-9e5e-47d3-9c56-10fe47d51d0f", "name": "network-vif-plugged", "status": "completed", "tag": "8a351264-c070-4d96-83c2-fbab580295f1"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:14.873636 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4b9e4e6f-fe2e-4e21-8e95-1ab1b3fee3b0 req-e3b056d8-98e8-4411-90e0-6f0b774ad827 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:14.874108 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4b9e4e6f-fe2e-4e21-8e95-1ab1b3fee3b0 req-e3b056d8-98e8-4411-90e0-6f0b774ad827 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:14.874529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4b9e4e6f-fe2e-4e21-8e95-1ab1b3fee3b0 req-e3b056d8-98e8-4411-90e0-6f0b774ad827 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:14.885091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-4b9e4e6f-fe2e-4e21-8e95-1ab1b3fee3b0 req-e3b056d8-98e8-4411-90e0-6f0b774ad827 service nova] Creating event network-vif-plugged:8a351264-c070-4d96-83c2-fbab580295f1 for instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f on hv-cinder-85919 Oct 04 10:38:14.890904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-4b9e4e6f-fe2e-4e21-8e95-1ab1b3fee3b0 req-e3b056d8-98e8-4411-90e0-6f0b774ad827 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031297 Oct 04 10:38:14.891585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 199/407] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:15.362763 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:15.363383 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:15.369857 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:15.370284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:15.370758 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:15.371451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:15.371984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:15.372414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:15.503872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:15.506348 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:15.515296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:15.516851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:15.518208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-51001b36-8cb8-404b-9cae-c02c3fb11fb6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.159289 Oct 04 10:38:15.518815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 209/408] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:15 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:15.878132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:15.878683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:15.884708 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:15.885231 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:15.885673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:15.886374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:15.886810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:15.887230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:15.912067 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a045b23c-42ce-4aeb-a3f0-d7e4d1f282b4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd/ips" status: 200 len: 150 microversion: 2.1 time: 0.038748 Oct 04 10:38:15.912622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 200/409] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:38:15 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:15.925020 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "597d4180-5cab-4e30-901b-73adb08c095a"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:15.927501 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:15.934665 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:15.935148 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:15.935589 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:15.936347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:15.936883 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:15.937310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:16.021733 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Invalid volume: volume 597d4180-5cab-4e30-901b-73adb08c095a is already attached to instances: d3abce48-e799-41d3-8ec2-00fc9a8e059c Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: POST /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd/os-volume_attachments HTTP/1.1 Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 74 Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:38:16.023489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {"volumeAttachment": {"volumeId": "597d4180-5cab-4e30-901b-73adb08c095a"}} Oct 04 10:38:16.025000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Invalid volume: volume 597d4180-5cab-4e30-901b-73adb08c095a is already attached to instances: d3abce48-e799-41d3-8ec2-00fc9a8e059c Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'server_id': 'c4069cc0-c304-4868-b731-29e1becb18bd', 'body': {'volumeAttachment': {'volumeId': '597d4180-5cab-4e30-901b-73adb08c095a'}}} Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 597d4180-5cab-4e30-901b-73adb08c095a is already attached to instances: d3abce48-e799-41d3-8ec2-00fc9a8e059c Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:16.025779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 597d4180-5cab-4e30-901b-73adb08c095a is already attached to instances: d3abce48-e799-41d3-8ec2-00fc9a8e059c Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:16.027003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 597d4180-5cab-4e30-901b-73adb08c095a is already attached to instances: d3abce48-e799-41d3-8ec2-00fc9a8e059c Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 400 to user: Invalid volume: volume 597d4180-5cab-4e30-901b-73adb08c095a is already attached to instances: d3abce48-e799-41d3-8ec2-00fc9a8e059c {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4fae925e-da56-4cf4-acc9-299e259b1a34 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104033 Oct 04 10:38:16.029057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 210/410] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:38:15 2022] POST /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:38:16.034710 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:16.035205 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:16.041113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:16.041585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:16.042016 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:16.042714 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:16.043162 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:16.043579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:16.071626 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:38:16.452018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-16d3ba41-6694-4eb9-ac33-2c8ec2613730 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 204 len: 0 microversion: 2.1 time: 0.420807 Oct 04 10:38:16.452604 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 201/411] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:38:16 2022] DELETE /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:38:16.461648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:16.462287 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:16.470800 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:16.471280 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:16.471739 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:16.472587 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:16.473146 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:16.473569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:16.544493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:16.545117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:16.551547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:16.552037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:16.553145 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:16.554107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:16.554278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:16.554742 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:16.613846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:16.628269 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-96311717-f2c0-4b28-aff9-129acdd6e5d6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1682 microversion: 2.1 time: 0.171144 Oct 04 10:38:16.646901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 211/412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:16 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:16.707687 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:16.718675 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:16.720118 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:16.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e1d9334d-31c9-4084-9108-98fbd0de36e0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.181371 Oct 04 10:38:16.733026 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 202/413] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:16 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:38:17.653713 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:17.654362 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:17.660797 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:17.661964 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:17.662417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:17.663117 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:17.663579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:17.664009 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:17.749002 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:17.751555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:17.756294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:17.756807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:17.757272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:17.758068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:17.758491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:17.758911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:17.796163 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:17.804292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5faddfb9-7d72-4e0f-a7d6-b624e9927710 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1682 microversion: 2.1 time: 0.154334 Oct 04 10:38:17.804885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 212/414] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:17 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:17.893028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:17.902189 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:17.904824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:17.906112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3b8a7f6a-9ce4-43c2-8ef0-2ea457d5c798 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.162197 Oct 04 10:38:17.906889 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 203/415] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:17 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:38:18.828205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:18.828838 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:18.835647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:18.836132 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:18.836568 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:18.837512 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:18.837893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:18.843746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:18.932893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:18.933738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:18.944117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:18.944849 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:18.946068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:18.947291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:18.949134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:18.949746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:18.984065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:18.992284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a6dd48a6-4a11-4bf5-b7b3-e59a54705849 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1682 microversion: 2.1 time: 0.168635 Oct 04 10:38:18.996209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 213/416] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:18 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:19.230203 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:19.242727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:19.244822 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:19.247277 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e0326199-c36c-4cc4-b53a-0632f42382af tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1808 microversion: 2.20 time: 0.318305 Oct 04 10:38:19.248008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 204/417] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:18 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:19.924753 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-394a35a8-f61e-4633-a330-8667edfde3dc req-547f9c4b-a090-4cbb-9678-942809f4e595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4069cc0-c304-4868-b731-29e1becb18bd", "name": "network-vif-deleted", "tag": "9eba00f5-4349-4c7c-900c-29adad777ee3"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:19.941222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-394a35a8-f61e-4633-a330-8667edfde3dc req-547f9c4b-a090-4cbb-9678-942809f4e595 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:19.941222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-394a35a8-f61e-4633-a330-8667edfde3dc req-547f9c4b-a090-4cbb-9678-942809f4e595 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:19.941222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-394a35a8-f61e-4633-a330-8667edfde3dc req-547f9c4b-a090-4cbb-9678-942809f4e595 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:19.948383 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-394a35a8-f61e-4633-a330-8667edfde3dc req-547f9c4b-a090-4cbb-9678-942809f4e595 service nova] Creating event network-vif-deleted:9eba00f5-4349-4c7c-900c-29adad777ee3 for instance c4069cc0-c304-4868-b731-29e1becb18bd on hv-cinder-85919 Oct 04 10:38:19.954243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-394a35a8-f61e-4633-a330-8667edfde3dc req-547f9c4b-a090-4cbb-9678-942809f4e595 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Oct 04 10:38:19.955006 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 214/418] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:38:20.015863 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:20.016470 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:20.023372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:20.023859 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:20.024335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:20.025134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:20.025614 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:20.026163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:20.095539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:20.103570 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-50074101-e82e-49ca-81fd-1df4ac07bb5d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1615 microversion: 2.1 time: 0.091614 Oct 04 10:38:20.104039 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 205/419] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:20 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1615 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:20.274478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:20.275385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:20.283339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:20.284041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:20.284635 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:20.285378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:20.285835 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:20.286263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:20.432763 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:20.442738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:20.445015 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:20.446363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6d91c767-e159-4dcb-bd59-cd8267826312 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1795 microversion: 2.20 time: 0.176373 Oct 04 10:38:20.447439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 215/420] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:38:20 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1795 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:38:21.126763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:21.127304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:21.133853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:21.134337 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:21.134770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:21.135530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:21.135980 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:21.136401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:21.171069 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:21.171549 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:21.171974 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:21.172618 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lazy-loading 'fault' on Instance uuid c4069cc0-c304-4868-b731-29e1becb18bd {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:38:21.221341 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:21.229056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b533f299-dd3b-4a0b-9032-cefaeab103e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 200 len: 1332 microversion: 2.1 time: 0.106157 Oct 04 10:38:21.229611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 206/421] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:21 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:22.258465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:22.259074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:22.266240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:22.266718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:22.267159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:22.267840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:22.268291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:22.268713 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:22.281946 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd HTTP/1.1 Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:38:22.283586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:38:22.285200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'c4069cc0-c304-4868-b731-29e1becb18bd'} Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:38:22.286819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:38:22.288196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:22.289470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:38:22.289470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ff500225-6724-4dcc-86c7-4cca82bc7736 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 404 len: 111 microversion: 2.1 time: 0.030341 Oct 04 10:38:22.289470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 216/422] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:22 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:38:22.293876 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3a7b3fca-96c4-4590-89ca-f8803f1b0fae tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '.version_select at 0x7f9be958ff70>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:22.378512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3a7b3fca-96c4-4590-89ca-f8803f1b0fae tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014694578" status: 202 len: 0 microversion: 2.1 time: 0.088478 Oct 04 10:38:22.379117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 207/423] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 10:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014694578 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:38:23.464582 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:23.465218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:23.473130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:23.473130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:23.474081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:23.474781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:23.475266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:23.475688 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:23.646579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lazy-loading 'services' on Instance uuid d3abce48-e799-41d3-8ec2-00fc9a8e059c {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:38:23.973451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5cf5daf5-e4b1-440d-aa86-26f66d788847 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments/597d4180-5cab-4e30-901b-73adb08c095a" status: 202 len: 0 microversion: 2.1 time: 0.512874 Oct 04 10:38:23.974054 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 217/424] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:38:23 2022] DELETE /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments/597d4180-5cab-4e30-901b-73adb08c095a => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:38:23.987476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:23.991234 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:23.998358 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:23.998842 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:23.999273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:24.000025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:24.000453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:24.000893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:24.035651 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-925f8bfd-3092-4c16-8c7c-c87e2beac4ef tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052543 Oct 04 10:38:24.036208 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 208/425] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:38:23 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:25.049297 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:25.051614 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:25.058368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:25.059199 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:25.059754 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:25.060271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:25.060729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:25.061182 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:25.091108 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-835c443e-1e4b-4e51-a96a-b581400f859d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Oct 04 10:38:25.091597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 218/426] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:38:25 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:26.103551 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:26.105830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:26.112286 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:26.112759 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:26.113223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:26.113979 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:26.114413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:26.114831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:26.140198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:26.144315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2fd4c7d6-e59e-4b9c-892a-e6ff8def5a0a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044782 Oct 04 10:38:26.144869 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 209/427] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:38:26 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:38:26.208941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:26.209682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:26.216473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:26.216978 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:26.217431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:26.218098 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:26.218547 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:26.218970 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:26.244189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:38:26.600105 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fa18fccd-a55c-4e1f-beea-ae40e5feda7a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 204 len: 0 microversion: 2.1 time: 0.394620 Oct 04 10:38:26.600705 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 219/428] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:38:26 2022] DELETE /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:38:26.609507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:26.610125 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:26.617008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:26.617561 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:26.617939 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:26.618642 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:26.619103 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:26.619533 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:26.749305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:26.756725 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-934b0d8f-9b24-4e6a-b09f-53528a85fc2c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1682 microversion: 2.1 time: 0.151764 Oct 04 10:38:26.757316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 210/429] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:26 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:27.781567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:27.785385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:27.791683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:27.792178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:27.792510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:27.793842 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:27.795569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:27.796065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:28.019231 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:28.027230 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-25427838-f22d-47ce-9aae-082b0633f1d2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1682 microversion: 2.1 time: 0.251181 Oct 04 10:38:28.044256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 220/430] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:27 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:29.051927 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:29.052515 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:29.059637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:29.060116 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:29.060539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:29.061258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:29.061706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:29.062123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:29.277240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:29.285155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e675f8ae-cbea-481b-a7fc-4d08122bded3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1682 microversion: 2.1 time: 0.237421 Oct 04 10:38:29.285718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 211/431] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:29 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:29.652087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-0de5ca8b-1d46-4663-a1e1-bc056a403f44 req-a151b415-6f81-4057-9dff-f9406ca14a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3abce48-e799-41d3-8ec2-00fc9a8e059c", "name": "network-vif-deleted", "tag": "d810520c-46b9-4aab-8a42-ef00c1cfd722"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:29.658078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:29.663609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0de5ca8b-1d46-4663-a1e1-bc056a403f44 req-a151b415-6f81-4057-9dff-f9406ca14a30 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:29.664291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0de5ca8b-1d46-4663-a1e1-bc056a403f44 req-a151b415-6f81-4057-9dff-f9406ca14a30 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:29.664797 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0de5ca8b-1d46-4663-a1e1-bc056a403f44 req-a151b415-6f81-4057-9dff-f9406ca14a30 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:29.676814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-0de5ca8b-1d46-4663-a1e1-bc056a403f44 req-a151b415-6f81-4057-9dff-f9406ca14a30 service nova] Creating event network-vif-deleted:d810520c-46b9-4aab-8a42-ef00c1cfd722 for instance d3abce48-e799-41d3-8ec2-00fc9a8e059c on hv-cinder-85919 Oct 04 10:38:29.682795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-0de5ca8b-1d46-4663-a1e1-bc056a403f44 req-a151b415-6f81-4057-9dff-f9406ca14a30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036905 Oct 04 10:38:29.684425 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 221/432] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:30.309858 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:30.310628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:30.317327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:30.317811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:30.318239 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:30.318935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:30.319381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:30.319798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:30.357332 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:30.357889 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:30.358332 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:30.358792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lazy-loading 'fault' on Instance uuid d3abce48-e799-41d3-8ec2-00fc9a8e059c {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:38:30.405324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:30.417729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5ca614cb-d3dd-4a16-b6fd-bf70019b5e7e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 200 len: 1331 microversion: 2.1 time: 0.112183 Oct 04 10:38:30.419143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 212/433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:30 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:31.444621 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:31.445936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:31.452915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:31.453398 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:31.453831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:31.454714 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:31.455302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:31.455782 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:31.469579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c HTTP/1.1 Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:38:31.471205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:38:31.472916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'd3abce48-e799-41d3-8ec2-00fc9a8e059c'} Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:38:31.473728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:38:31.475177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:38:31.476437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:38:31.476437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-108310e7-ed99-490e-ad04-bd93c80bd6e0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 404 len: 111 microversion: 2.1 time: 0.033068 Oct 04 10:38:31.476437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 222/434] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:31 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:38:31.482402 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d6c8ec34-b977-4475-8d83-2b66c1f81452 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '.version_select at 0x7f9be95831f0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:31.595497 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d6c8ec34-b977-4475-8d83-2b66c1f81452 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-948902764" status: 202 len: 0 microversion: 2.1 time: 0.117493 Oct 04 10:38:31.596072 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 213/435] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 10:38:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-948902764 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:38:32.410625 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5e707f2b-a24e-4adb-902a-c202108b30d4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: .version_select at 0x7f9be94ebc10>, body: {"keypair": {"name": "tempest-keypair-363245923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPkso+SH/SbJDWSy/zJpnHUA7uk3ZcXb9BUy31UdfM2r3xACGtT+VcyoU31JpQjpvixCMllcXXvKWK8b+s8sRRQew1tH9esnoy57qxl2l2MiA3V5B5OP3ZdWIEgQvP98w=="}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:32.426230 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-5e707f2b-a24e-4adb-902a-c202108b30d4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:38:32.430156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-5e707f2b-a24e-4adb-902a-c202108b30d4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:38:32.454697 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37d6485b-cf57-490d-bcd6-6d7756c7f336"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:32.454697 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:32.460972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:32.461413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:32.461806 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:32.462499 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:32.462949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:32.463368 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:32.534925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5e707f2b-a24e-4adb-902a-c202108b30d4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126638 Oct 04 10:38:32.534925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 223/436] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:38:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:33.352339 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ea89b0ac-1046-4b61-a35c-039143f49b23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905871 Oct 04 10:38:33.353353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 214/437] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:38:32 2022] POST /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:35.040490 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1936846183", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1"}], "security_groups": [{"name": "tempest-securitygroup--1628530731"}], "key_name": "tempest-keypair-363245923", "user_data": "}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:35.159382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] validate_networks() for [('2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:38:35.531513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:38:35.531513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:38:35.531513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:38:35.531802 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:38:35.531945 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:38:35.540772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:35.541288 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:35.541730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:35.542459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:35.543489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:35.543923 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:35.561462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:38:35.565564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:38:35.576923 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:38:35.579222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:38:35.722672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cb44d740-5468-4594-85c5-3b303d11a646 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.687174 Oct 04 10:38:35.723311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 224/438] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:38:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:38:35.735799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-14070b01-0538-48eb-8506-c6a77951fafc tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:35.736490 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-14070b01-0538-48eb-8506-c6a77951fafc tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:35.792619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-14070b01-0538-48eb-8506-c6a77951fafc tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:35.801726 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-14070b01-0538-48eb-8506-c6a77951fafc tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1241 microversion: 2.1 time: 0.070208 Oct 04 10:38:35.802307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 215/439] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:35 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:36.826403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:36.827026 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:36.833165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:36.833643 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:36.834080 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:36.835062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:36.835511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:36.835934 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:36.910454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:36.919362 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-33be82e3-ce9d-43c4-ad0f-d16401d897e8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1245 microversion: 2.1 time: 0.096542 Oct 04 10:38:36.919959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 225/440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:36 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:37.943542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:37.944159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:37.951569 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:37.952057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:37.953065 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:37.953330 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:37.953797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:37.954232 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:38.020045 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:38.028535 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-372a4574-3675-419f-bd3f-ce968e40322c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1293 microversion: 2.1 time: 0.088601 Oct 04 10:38:38.034419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 216/441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:37 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:39.052382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:39.052963 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:39.060175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:39.060657 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:39.061128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:39.061822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:39.062269 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:39.062717 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:39.214993 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:39.217956 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5385a778-3666-498d-a5e3-5a23ad866af8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.169531 Oct 04 10:38:39.218533 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 226/442] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:39 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:40.095871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-2bb61b86-0227-423c-b476-03f2bdf1fddf req-30e14606-ce6d-4527-bf7c-fe88fd47df37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719e90e9-ee4b-4132-8f1c-c29c32a37bac", "tag": "5293be1e-a131-4d90-a1e1-46554bf2e131"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:40.107892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-2bb61b86-0227-423c-b476-03f2bdf1fddf req-30e14606-ce6d-4527-bf7c-fe88fd47df37 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:40.108369 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-2bb61b86-0227-423c-b476-03f2bdf1fddf req-30e14606-ce6d-4527-bf7c-fe88fd47df37 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:40.109096 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-2bb61b86-0227-423c-b476-03f2bdf1fddf req-30e14606-ce6d-4527-bf7c-fe88fd47df37 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:40.120773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-2bb61b86-0227-423c-b476-03f2bdf1fddf req-30e14606-ce6d-4527-bf7c-fe88fd47df37 service nova] Creating event network-changed:5293be1e-a131-4d90-a1e1-46554bf2e131 for instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac on hv-cinder-85919 Oct 04 10:38:40.126631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-2bb61b86-0227-423c-b476-03f2bdf1fddf req-30e14606-ce6d-4527-bf7c-fe88fd47df37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034691 Oct 04 10:38:40.127420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 217/443] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:40.241186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:40.241820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:40.248457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:40.248959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:40.249396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:40.250078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:40.250531 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:40.250953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:40.401126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:40.411217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c94957e8-46ed-41c7-809c-62eb3e26f837 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.173672 Oct 04 10:38:40.412052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 227/444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:40 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:41.439288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:41.439976 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:41.446508 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:41.446980 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:41.447413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:41.448107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:41.448598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:41.449048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:41.585826 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:41.594838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0904fb91-28d5-4c7a-9176-5e0dba141411 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.160472 Oct 04 10:38:41.595401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 218/445] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:41 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:41.968466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:41.970786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:41.977206 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:41.977689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:41.978128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:41.978815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:41.979270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:41.979695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:41.993801 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:42.007571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'flavor' on Instance uuid 2a2d2b30-9c51-470d-aa3b-edc245fff08b {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:38:42.439484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9a6ffc5c-d4dc-414f-9bf6-9cac9d1e21ca tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/action" status: 200 len: 32 microversion: 2.1 time: 0.475439 Oct 04 10:38:42.440006 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 228/446] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:38:41 2022] POST /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/action => generated 32 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:38:42.449732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:42.450977 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:42.457632 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:42.458120 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:42.458573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:42.459259 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:42.459969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:42.460395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:42.603919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:42.624190 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:42.625122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:42.630522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-36342816-b68f-41e0-bb48-87647eb576fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.184537 Oct 04 10:38:42.631666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 219/447] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:42 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:42.632158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:42.632750 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:42.633414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:42.634218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:42.634884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:42.635387 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:42.797611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:42.797611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-072f774b-b80d-4655-9238-f19b31ec6181 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.173208 Oct 04 10:38:42.797611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 229/448] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:42 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:43.655781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:43.656397 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:43.658838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:43.663535 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:43.664016 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:43.664452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:43.665166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:43.665663 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:43.666101 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:43.797769 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:43.806029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b900dbd8-bbf9-4f4f-a311-205a7aada8e1 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.154263 Oct 04 10:38:43.806591 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 220/449] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:43 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:43.814564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:43.820333 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:43.821848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:43.822334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:43.822779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:43.823472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:43.823957 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:43.824381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:43.958801 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:43.967409 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-54915017-ded8-4095-bdf5-c3a4930d027e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.156765 Oct 04 10:38:43.967963 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 230/450] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:43 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:44.830920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:44.831539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:44.839096 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:44.839825 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:44.840278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:44.840997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:44.841454 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:44.842143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:44.936577 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-01e2e62a-4927-474e-8e1e-e3e038133789 req-b9bcef4f-da5f-4067-803f-1cb84608f521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719e90e9-ee4b-4132-8f1c-c29c32a37bac", "name": "network-vif-plugged", "status": "completed", "tag": "5293be1e-a131-4d90-a1e1-46554bf2e131"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:44.949150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-01e2e62a-4927-474e-8e1e-e3e038133789 req-b9bcef4f-da5f-4067-803f-1cb84608f521 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:44.949822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-01e2e62a-4927-474e-8e1e-e3e038133789 req-b9bcef4f-da5f-4067-803f-1cb84608f521 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:44.950295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-01e2e62a-4927-474e-8e1e-e3e038133789 req-b9bcef4f-da5f-4067-803f-1cb84608f521 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:44.966328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-01e2e62a-4927-474e-8e1e-e3e038133789 req-b9bcef4f-da5f-4067-803f-1cb84608f521 service nova] Creating event network-vif-plugged:5293be1e-a131-4d90-a1e1-46554bf2e131 for instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac on hv-cinder-85919 Oct 04 10:38:44.969676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-01e2e62a-4927-474e-8e1e-e3e038133789 req-b9bcef4f-da5f-4067-803f-1cb84608f521 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039418 Oct 04 10:38:44.970596 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 231/451] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:44.990418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:44.991760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:44.992570 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:44.999724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:44.999915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-95252e5b-d5ee-45e8-ad79-21ee7a7ae036 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.172793 Oct 04 10:38:45.000421 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:45.000590 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 221/452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:44 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:45.001187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:45.002058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:45.002522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:45.002951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:45.190432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:45.198082 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5d52b56d-f1f0-41f9-9447-929eeb0a0be7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.211075 Oct 04 10:38:45.198646 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 232/453] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:44 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:46.023681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:46.024290 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:46.026139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:46.031380 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:46.035547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:46.035547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:46.035547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:46.035547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:46.035936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:46.164725 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:46.172977 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bdd27d01-3bd1-4b1e-ac23-2e92ec8658c3 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.153126 Oct 04 10:38:46.173540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 222/454] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:46 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:46.220954 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:46.221703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:46.223682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:46.224372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=10 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:46.229540 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:46.230025 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:46.230467 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:46.231161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:46.231647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:46.232129 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:46.361562 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:46.369506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bfd575cc-db0a-4787-91b2-d1cb530b2f45 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.152315 Oct 04 10:38:46.370253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 233/455] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:46 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:47.197167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:47.197773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:47.205686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:47.206225 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:47.206884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:47.207584 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:47.208033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:47.208455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:47.345572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:47.354071 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6b3b7963-9bb0-45f8-bc7d-bda1046071ea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.160822 Oct 04 10:38:47.354637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 223/456] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:47 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:47.393987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:47.394602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:47.401407 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:47.401891 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:47.402327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:47.403013 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:47.404058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:47.404550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:47.542404 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:47.551057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9de25c14-ce68-4a9e-834a-5b579a5d61a2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1367 microversion: 2.1 time: 0.160890 Oct 04 10:38:47.551612 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 234/457] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:47 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:48.379274 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:48.379904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:48.386970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:48.395060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:48.395060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:48.395060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:48.395060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:48.395580 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:48.532692 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:48.543417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-714fe3bb-98ff-4180-9407-aa21da90638f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.168098 Oct 04 10:38:48.544883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 224/458] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:48 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:48.574443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:48.575709 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:48.582284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:48.582760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:48.583191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:48.584022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:48.584784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:48.585234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:48.716989 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:48.725891 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5baec401-cf6b-48c6-b965-6658b90df8b8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1557 microversion: 2.1 time: 0.155207 Oct 04 10:38:48.726489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 235/459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:48 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:48.754773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:48.755256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:48.761164 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:48.761641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:48.762074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:48.763754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:48.764216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:48.764641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:48.851550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2f99a4cd-ae51-46f0-8ed1-df4f70c5508b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100583 Oct 04 10:38:48.852183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 225/460] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:38:48 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:49.567915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:49.568542 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:49.574423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:49.574900 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:49.575972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:49.576597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:49.577339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:49.577772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:49.829040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:49.838074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-92f56945-711f-41b3-bf48-f8f509070c97 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.273867 Oct 04 10:38:49.838731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 236/461] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:49 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:50.149092 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-ae9675bc-6285-4534-b85c-6e6b7e1d3ba4 req-66b2c4b3-193d-4f2b-907e-53054d6664e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719e90e9-ee4b-4132-8f1c-c29c32a37bac", "tag": "5293be1e-a131-4d90-a1e1-46554bf2e131"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:50.158745 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ae9675bc-6285-4534-b85c-6e6b7e1d3ba4 req-66b2c4b3-193d-4f2b-907e-53054d6664e9 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:50.159225 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ae9675bc-6285-4534-b85c-6e6b7e1d3ba4 req-66b2c4b3-193d-4f2b-907e-53054d6664e9 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:50.159656 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ae9675bc-6285-4534-b85c-6e6b7e1d3ba4 req-66b2c4b3-193d-4f2b-907e-53054d6664e9 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:50.172014 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-ae9675bc-6285-4534-b85c-6e6b7e1d3ba4 req-66b2c4b3-193d-4f2b-907e-53054d6664e9 service nova] Creating event network-changed:5293be1e-a131-4d90-a1e1-46554bf2e131 for instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac on hv-cinder-85919 Oct 04 10:38:50.179272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-ae9675bc-6285-4534-b85c-6e6b7e1d3ba4 req-66b2c4b3-193d-4f2b-907e-53054d6664e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034456 Oct 04 10:38:50.180086 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 226/462] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:38:50.532446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:50.533267 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:50.539538 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:50.540283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:50.540739 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:50.541714 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:50.542179 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:50.542640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:50.633707 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'services' on Instance uuid eeea5c57-433b-4799-9515-799453a51522 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:38:50.850662 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e17f1b6c-d4ed-4e9a-baed-ea7349d79c2d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-volume_attachments/1c70e99f-331e-497e-b854-5aa2ec8b250d" status: 202 len: 0 microversion: 2.1 time: 0.323230 Oct 04 10:38:50.851257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 237/463] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:38:50 2022] DELETE /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-volume_attachments/1c70e99f-331e-497e-b854-5aa2ec8b250d => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:38:50.863268 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:50.863977 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:50.870545 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:50.872548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:50.873266 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:50.874170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:50.874804 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:50.875400 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:51.023731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:51.032660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a5dbdac6-3f8e-4de9-80e3-019dba00f0e2 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.173508 Oct 04 10:38:51.033480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 227/464] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:50 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:52.010184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e770eb69-1a28-4f42-bb24-cc33a1ed9f0a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:38:52.017041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e770eb69-1a28-4f42-bb24-cc33a1ed9f0a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:52.017520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e770eb69-1a28-4f42-bb24-cc33a1ed9f0a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:52.017942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e770eb69-1a28-4f42-bb24-cc33a1ed9f0a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:52.039406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e770eb69-1a28-4f42-bb24-cc33a1ed9f0a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Going to try to stop instance {{(pid=127628) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 10:38:52.056436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:52.057746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:52.065107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:52.065600 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:52.066042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:52.066754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:52.067212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:52.067628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:52.086719 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:52.199643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:52.208270 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-37903476-7f93-4f82-9116-9c4be05c96b8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.155776 Oct 04 10:38:52.208826 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 228/465] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:52 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:52.307241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e770eb69-1a28-4f42-bb24-cc33a1ed9f0a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action" status: 202 len: 0 microversion: 2.1 time: 0.301425 Oct 04 10:38:52.308301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 238/466] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:38:52 2022] POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:38:52.316963 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:52.317952 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:52.324383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:52.325747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:52.326528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:52.327559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:52.328521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:52.329140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:52.466808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:52.475514 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-da8d84b1-9754-40b9-9d45-ff736119c85d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.162719 Oct 04 10:38:52.476084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 229/467] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:52 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:53.232484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:53.233215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:53.239591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:53.240074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:53.240506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:53.241254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:53.241704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:53.242125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:53.376593 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:53.385774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2b2f6482-a1b0-4fcc-8c92-afc05e157f6f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.157964 Oct 04 10:38:53.386340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 239/468] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:53 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:53.500318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:53.500964 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:53.508063 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:53.508541 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:53.509022 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:53.509721 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:53.510180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:53.510602 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:53.650485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:53.658557 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4f80b980-3497-4540-a541-46eb636ddc66 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.163027 Oct 04 10:38:53.659113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 230/469] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:53 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:54.410301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:54.410906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:54.417409 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:54.417887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:54.418316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:54.419133 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:54.419667 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:54.420092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:54.548515 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:54.556702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ae2b36fa-0b68-4980-b449-580366c76259 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.150352 Oct 04 10:38:54.557353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 240/470] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:54 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:54.681978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:54.682488 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:54.688961 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:54.689448 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:54.689886 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:54.690573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:54.691026 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:54.691449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:54.817887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:54.826272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-65100231-26a7-4bbe-9cb5-09f01a7dd864 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.148240 Oct 04 10:38:54.827180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 231/471] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:54 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:55.579728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:55.580247 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:55.586898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:55.587379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:55.587815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:55.588498 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:55.588977 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:55.589403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:55.727937 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:55.736816 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-476781fd-3722-4ec2-bf07-609857c83b49 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.161216 Oct 04 10:38:55.737398 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 241/472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:55 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:55.851005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:55.851539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:55.858724 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:55.859198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:55.859666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:55.860347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:55.860797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:55.861241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:55.994491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:56.002317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e73e8428-4389-4806-96a7-7696470d1788 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.155643 Oct 04 10:38:56.002882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 232/473] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:55 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:56.760488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:56.761126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:56.768833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:56.769352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:56.769787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:56.770476 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:56.770929 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:56.771353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:56.777414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:56.911510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:56.920746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-68b9c42c-c647-4e13-a436-181ba52a648b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.164094 Oct 04 10:38:56.921348 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 242/474] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:56 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:57.026080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:57.026799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:57.034183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:57.034732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:57.035254 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:57.036008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:57.036553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:57.037161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:57.171635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:57.179441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f9ba9f83-1f25-40b9-9fe3-302f1a11ff18 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.157420 Oct 04 10:38:57.180000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 233/475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:57 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:57.943985 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:57.944519 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:57.951796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:57.952272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:57.952705 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:57.953549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:57.953844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:57.954261 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:58.086684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:58.095017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7f887d89-51d7-48c2-a3d5-3f3b381580d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.155335 Oct 04 10:38:58.095585 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 243/476] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:57 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:58.203778 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:58.204451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:58.211416 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:58.211908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:58.212405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:58.213136 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:58.213597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:58.214026 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:58.348028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:58.355702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4f1c66e2-08bb-44fa-afd1-9ee02636f0c4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.156569 Oct 04 10:38:58.356805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 234/477] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:58 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:38:58.578694 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:58.579188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:58.585497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:58.586034 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:58.586478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:58.587174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:58.587631 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:58.588054 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:58.617507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-79aab433-f9de-46eb-acb4-98b17db00b7d tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments/428d7042-0c92-488b-967f-f1e73dbac8f6" status: 200 len: 194 microversion: 2.20 time: 0.042899 Oct 04 10:38:58.618105 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 244/478] 10.222.0.42 () {60 vars in 1454 bytes} [Tue Oct 4 10:38:58 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments/428d7042-0c92-488b-967f-f1e73dbac8f6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:38:58.690532 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:58.691023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:58.696890 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:58.697353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:58.697782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:58.698464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:58.698910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:58.699325 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:58.829106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lazy-loading 'services' on Instance uuid 64d9120a-9e5e-47d3-9c56-10fe47d51d0f {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:38:59.117435 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:59.118208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:59.118875 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-058b67f3-0161-43c3-b346-b650cd12b696 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments/428d7042-0c92-488b-967f-f1e73dbac8f6" status: 202 len: 0 microversion: 2.20 time: 0.432019 Oct 04 10:38:59.119581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 235/479] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Oct 4 10:38:58 2022] DELETE /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments/428d7042-0c92-488b-967f-f1e73dbac8f6 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:38:59.125524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:59.126291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:59.126920 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:59.127626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:59.128084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:59.128603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:59.129103 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:59.131445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:59.138115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:59.138632 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:59.139037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:59.139713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:59.140183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:59.145528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:59.183233 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2fd5205f-21df-4bed-aaf2-f1b47d746fa1 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058502 Oct 04 10:38:59.183812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 236/480] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 10:38:59 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:38:59.281702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:59.290110 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1de293a2-8f02-4dab-bd00-5b6b6b16b8be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.176594 Oct 04 10:38:59.290597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 245/481] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:59 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:38:59.380225 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:38:59.380974 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:38:59.388018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:59.388509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:59.388963 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:59.389648 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:38:59.390096 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:38:59.390512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:38:59.525348 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:38:59.533223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cb96d2bf-d718-49fd-9855-924dcec5548e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.156719 Oct 04 10:38:59.533792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 237/482] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:38:59 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:00.195835 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:00.198163 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:00.204837 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:00.205357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:00.205794 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:00.206490 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:00.206942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:00.207369 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:00.239634 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c70aed17-3247-4b79-a02c-19bbfb25ea86 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047865 Oct 04 10:39:00.243467 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 246/483] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 10:39:00 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:39:00.313279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:00.313885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:00.319749 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:00.320234 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:00.320672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:00.321383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:00.321838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:00.322261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:00.461464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:00.470240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-04cdf8e2-cb33-4e38-9030-ccaa9c9f2dba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.161023 Oct 04 10:39:00.470796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 238/484] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:00 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:00.555773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:00.556654 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:00.564131 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:00.564701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:00.565253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:00.566066 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:00.566725 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:00.567217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:00.709018 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:00.719508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7716ccf5-d34f-4545-be52-91a675cee78a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.167689 Oct 04 10:39:00.720888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 247/485] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:00 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:01.255838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:01.259113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:01.266712 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.267423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.268006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.268853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.273517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.273517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.306887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1f2ae008-5dab-4d25-a5d3-04d08c32a969 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057814 Oct 04 10:39:01.307466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 239/486] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 10:39:01 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:01.387208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:01.393007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:01.395039 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.395534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.395972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.396683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.397491 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.397632 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.427748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:39:01.493991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:01.494574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:01.502886 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.503734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.504506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.505972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.512290 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.512290 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.691015 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:01.699422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-84e3cce9-aae8-414c-90aa-d0d45d2e8f46 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.209329 Oct 04 10:39:01.700256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 240/487] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:01 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:01.743513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:01.744201 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:01.750196 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.750677 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.751112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.751797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.752251 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.752883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.759500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-08a6b6cf-2a38-48df-97ab-34e9d9cc97de tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 204 len: 0 microversion: 2.20 time: 0.377645 Oct 04 10:39:01.760419 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 248/488] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 10:39:01 2022] DELETE /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 10:39:01.769402 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:01.769721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:01.775990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.776662 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.777259 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.778868 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:01.779406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:01.779937 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:01.901173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:01.912047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-67d997ed-da37-4f64-84a7-4d8e5ffd26e5 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.172229 Oct 04 10:39:01.912639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 241/489] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:01 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:01.945391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:01.953867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:01.961309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:01.961309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-67e17502-4f70-4ac6-bab6-cbce84c5101b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.191574 Oct 04 10:39:01.961309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 249/490] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:01 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:02.723803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:02.731797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:02.731797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:02.731797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:02.731797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:02.732588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:02.733092 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:02.733515 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:02.872787 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:02.881004 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-da4112b5-6403-43a8-93c0-416288f60477 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.160898 Oct 04 10:39:02.881584 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 242/491] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:02 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:02.937326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:02.938081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:02.941013 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:02.946450 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:02.946959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:02.947433 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:02.948223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:02.948771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:02.949307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:02.990622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:02.991228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:02.997978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:02.998481 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:02.998920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:02.999626 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:03.000082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:03.000509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:03.121760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:03.138107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:03.145264 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6acc213c-2193-4bbc-97e3-ed9c6398e3c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1678 microversion: 2.1 time: 0.213218 Oct 04 10:39:03.145848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 250/492] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:02 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:03.147657 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:03.149458 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:03.150701 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-966599cc-c332-4967-8a6d-a556225a0533 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1723 microversion: 2.20 time: 0.163989 Oct 04 10:39:03.151558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 243/493] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:02 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:39:03.907581 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:03.908571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:03.918049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:03.928307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:03.928307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:03.928307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:03.928307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:03.928711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.066224 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:04.075134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-107732ae-4c42-4b1b-98be-a8754ec8405b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.175234 Oct 04 10:39:04.075693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 251/494] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:03 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:04.169779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:04.170423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:04.178729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.178729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.179123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.179968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:04.180450 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.180561 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:04.181169 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.181766 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.188948 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.189744 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.190355 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.191428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.191886 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.192435 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.212351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:04.280251 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:04.290271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:04.293404 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:04.294771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8b03733b-8299-40db-9ae7-734d24ab502b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1656 microversion: 2.20 time: 0.119522 Oct 04 10:39:04.297885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 252/495] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:04 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1656 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:04.465479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:04.474200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-038a1217-0fd6-425e-bee1-89fbb5de7462 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1655 microversion: 2.1 time: 0.308550 Oct 04 10:39:04.474787 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 244/496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:04 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1655 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:04.501064 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-890cd753-a42a-4817-b2af-3d166640b730 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:04.507820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-890cd753-a42a-4817-b2af-3d166640b730 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.508569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-890cd753-a42a-4817-b2af-3d166640b730 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.509260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-890cd753-a42a-4817-b2af-3d166640b730 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.533888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-890cd753-a42a-4817-b2af-3d166640b730 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Going to try to start instance {{(pid=127628) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 10:39:04.706455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-79fbaf69-c5a8-4d0e-a370-305f8da6b48c req-6b4be531-3b67-4a20-a9ad-3bfdc6ba2e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d9120a-9e5e-47d3-9c56-10fe47d51d0f", "name": "network-vif-deleted", "tag": "8a351264-c070-4d96-83c2-fbab580295f1"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:04.720412 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-79fbaf69-c5a8-4d0e-a370-305f8da6b48c req-6b4be531-3b67-4a20-a9ad-3bfdc6ba2e3c service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.721105 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-79fbaf69-c5a8-4d0e-a370-305f8da6b48c req-6b4be531-3b67-4a20-a9ad-3bfdc6ba2e3c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.721647 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-79fbaf69-c5a8-4d0e-a370-305f8da6b48c req-6b4be531-3b67-4a20-a9ad-3bfdc6ba2e3c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.744075 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-79fbaf69-c5a8-4d0e-a370-305f8da6b48c req-6b4be531-3b67-4a20-a9ad-3bfdc6ba2e3c service nova] Creating event network-vif-deleted:8a351264-c070-4d96-83c2-fbab580295f1 for instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f on hv-cinder-85919 Oct 04 10:39:04.752742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-890cd753-a42a-4817-b2af-3d166640b730 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action" status: 202 len: 0 microversion: 2.1 time: 0.255931 Oct 04 10:39:04.756283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 253/497] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:39:04 2022] POST /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:39:04.764808 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:04.766294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:04.773111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-79fbaf69-c5a8-4d0e-a370-305f8da6b48c req-6b4be531-3b67-4a20-a9ad-3bfdc6ba2e3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061822 Oct 04 10:39:04.773760 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 245/498] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:04.781358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.784979 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.784979 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.784979 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:04.784979 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:04.785449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:04.960798 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:04.968833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0e11e3cd-7923-4bab-a82c-1c84d51e3203 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1664 microversion: 2.1 time: 0.210819 Oct 04 10:39:04.969429 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 254/499] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:04 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1664 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:05.106626 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:05.107647 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:05.116491 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:05.128971 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:05.129521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:05.130273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:05.130741 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:05.131303 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:05.286805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:05.295719 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0cf5da84-5364-48e3-8d4b-ce4c0cf606fd tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.193645 Oct 04 10:39:05.296521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 246/500] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:05 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:05.325439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:05.326051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:05.332330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:05.332932 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:05.333438 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:05.334193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:05.335115 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:05.335602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:05.399269 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:05.408112 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:05.409586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:05.410721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7c0c3435-a931-44de-b406-23fce78f740b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 200 len: 1367 microversion: 2.20 time: 0.089902 Oct 04 10:39:05.411279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 255/501] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:05 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:39:05.991688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:05.992367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:05.999809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.000298 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.000734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.001462 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.001915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.002381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.136458 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:06.144361 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ee917386-0773-4938-973e-8fc3c283a699 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1664 microversion: 2.1 time: 0.156646 Oct 04 10:39:06.144940 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 247/502] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:05 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:06.287107 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-602389699", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "networks": [{"uuid": "469606a8-b8ac-434f-83d0-93dfd880057a"}]}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:06.318634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:06.319239 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:06.325585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.326129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.326758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.327452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.327903 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.328326 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.341327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] validate_networks() for [('469606a8-b8ac-434f-83d0-93dfd880057a', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:39:06.459148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:06.468723 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5009f8ab-dce9-4a6f-b0b1-7a64e8d7bfea tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1735 microversion: 2.1 time: 0.153721 Oct 04 10:39:06.469991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 248/503] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:06 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:06.474869 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:06.486949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:06.496811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.496811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.496811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.497362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.497819 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.498288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.512950 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] HTTP exception thrown: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Request method failure captured: Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f HTTP/1.1 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxrfwU74xCGOLv_q7Hq1B2hm1nib2SOcP5bIEyF7bGyrEiWK3eZBDaV4FtwPFj6vvIifWdZvBgaD5xiV_fQATed_AJRLvb68K536LCHbdKy-cFf6JZrYiF-B2L1M7KYD3P654FlO2qMFo-_vyWINBjaYaum8O-mXfHOf95yFGr4lG0 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:39:06.514671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17e605186f7944a79d36288d99d1eaa9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 3c7fcc99edab427aa2b750bf6b15b39c Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:39:06.516091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '64d9120a-9e5e-47d3-9c56-10fe47d51d0f'} Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:39:06.516878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:39:06.518291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:06.519413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Returning 404 to user: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:39:06.519413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1bea24d0-883c-4af3-9d91-fb8f012cc389 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 404 len: 111 microversion: 2.20 time: 0.044906 Oct 04 10:39:06.519413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 249/504] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:06 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:39:06.525113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bc5596ef-f508-4731-889c-51b60179a6a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '.version_select at 0x7f9be9680b80>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:06.625899 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bc5596ef-f508-4731-889c-51b60179a6a4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762534592" status: 204 len: 0 microversion: 2.20 time: 0.104358 Oct 04 10:39:06.626480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 250/505] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 10:39:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762534592 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 10:39:06.731753 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:39:06.732173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:39:06.732689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:39:06.733210 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:39:06.733677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:39:06.743001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.743476 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.743904 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.744622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:06.745403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:06.745831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:06.752728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:06.763371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Getting quotas for project 7d344597211d4f6b9a3c7961e7b0f706. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:39:06.768040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Getting quotas for user f8d11882baae44968b8d451d6a30af87 and project 7d344597211d4f6b9a3c7961e7b0f706. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:39:06.779349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:39:06.782371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:39:06.910321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4f3f339c-54da-4525-bbce-4d014b0602ab tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626981 Oct 04 10:39:06.911222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 256/506] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:39:06.922678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-031d76ea-a6df-4448-a642-268903f5d5bf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:06.923524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-031d76ea-a6df-4448-a642-268903f5d5bf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:06.989149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-031d76ea-a6df-4448-a642-268903f5d5bf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:06.999414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-031d76ea-a6df-4448-a642-268903f5d5bf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1218 microversion: 2.1 time: 0.080998 Oct 04 10:39:07.000076 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 251/507] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:06 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:07.167942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:07.168549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:07.175854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.176339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.176775 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:07.177565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.178075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.178680 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:07.396139 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:07.404005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-454c58b4-35a3-4383-b934-53343ae836bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1664 microversion: 2.1 time: 0.240047 Oct 04 10:39:07.404683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 257/508] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:07 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1664 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:07.494441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:07.494998 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:07.501768 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.502248 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.502684 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:07.503364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.503968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.504391 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:07.654218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8605dc2b-3e62-427d-b589-9ea00ab7766a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'create', calling method: .version_select at 0x7f9be94ad280>, body: {"keypair": {"name": "tempest-keypair-795972874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGvJUqCtUd87jB1HdZaOyRnL7k1okqTUQaf/8tbUMdVVqgMqUOloCoR4gQl3zSGC2x54fvCvgH4utPPMbnWc280ciMweCDe1ioaLQSeh5WFqH2hvk4EusJJCuqA2RJuWw=="}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:07.658406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:07.667652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-819ed303-3f3c-46cd-89ab-53845cc890be tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1715 microversion: 2.1 time: 0.177093 Oct 04 10:39:07.668218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 252/509] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:07 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1715 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:07.673610 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-8605dc2b-3e62-427d-b589-9ea00ab7766a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for project 17e605186f7944a79d36288d99d1eaa9. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:39:07.677509 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-8605dc2b-3e62-427d-b589-9ea00ab7766a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for user 3c7fcc99edab427aa2b750bf6b15b39c and project 17e605186f7944a79d36288d99d1eaa9. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:39:07.780776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8605dc2b-3e62-427d-b589-9ea00ab7766a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.132911 Oct 04 10:39:07.783025 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 258/510] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 10:39:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 10:39:07.793042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:07.793543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:07.800706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.801213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.801645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:07.802468 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.802843 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.803265 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:07.888461 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] HTTP exception thrown: Cannot 'detach_volume' instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b while it is in vm_state rescued Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Request method failure captured: Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments/37d6485b-cf57-490d-bcd6-6d7756c7f336 HTTP/1.1 Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxrmNYd0EZ-22UGk_kKNY6-0U_YRbMfiBo-fxh7FZTtqb9rUroRPcVLUU-SbHpoTBcklmVbnvHkoYEQdtmLGXc7YkGQnXycCpMq6KhWtCeEcQxXaTCbjv5IgzPz4dGOSeijd4m0FZuRhHTH7qqPMbzi5nZUEFx_XbtAY9B33MXP2Vc Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:39:07.890021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e94e5705bcfd476e87b2fa0af6ff597a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: c4f4844eb5e14d789476cfb44e2516f0 Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:39:07.891404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Cannot 'detach_volume' instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b while it is in vm_state rescued Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'server_id': '2a2d2b30-9c51-470d-aa3b-edc245fff08b', 'id': '37d6485b-cf57-490d-bcd6-6d7756c7f336'} Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:39:07.892185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b while it is in vm_state rescued Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b while it is in vm_state rescued Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:07.893401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Returning 409 to user: Cannot 'detach_volume' instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b while it is in vm_state rescued {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:39:07.894410 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9bd9996a-f895-4dc3-84de-9a1e7fc72c1b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments/37d6485b-cf57-490d-bcd6-6d7756c7f336" status: 409 len: 152 microversion: 2.1 time: 0.105465 Oct 04 10:39:07.894410 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 253/511] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:39:07 2022] DELETE /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments/37d6485b-cf57-490d-bcd6-6d7756c7f336 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 10:39:07.900627 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:07.901495 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:07.908340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.908820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.909279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:07.909969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:07.910412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:07.910832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:08.026100 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0b0dc97b-6195-4492-b8fe-f36171819b0b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:08.026750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0b0dc97b-6195-4492-b8fe-f36171819b0b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:08.108366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0b0dc97b-6195-4492-b8fe-f36171819b0b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:08.122746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0b0dc97b-6195-4492-b8fe-f36171819b0b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1218 microversion: 2.1 time: 0.099008 Oct 04 10:39:08.122746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 254/512] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:08 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:08.147526 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-59d38c9e-d06a-4b2c-ac48-d6d0bb1896fe tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "POST /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/action" status: 202 len: 0 microversion: 2.1 time: 0.249747 Oct 04 10:39:08.147526 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 259/513] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:39:07 2022] POST /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:39:08.157159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:08.158006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:08.164781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:08.165321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:08.165763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:08.166465 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:08.166919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:08.167344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:08.428330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:08.429022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:08.435340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:08.436361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:08.436799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:08.438142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:08.438628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:08.443767 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:08.580050 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:08.588888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ad81a2d6-82b5-4810-a7c6-bbdb8007a3d6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1668 microversion: 2.1 time: 0.165247 Oct 04 10:39:08.589478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 260/514] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:08 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:08.693846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:08.703275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0d1067f5-d217-463a-a61e-a995e5462b03 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1723 microversion: 2.1 time: 0.551474 Oct 04 10:39:08.703936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 255/515] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:08 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1723 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:09.144162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:09.146063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:09.150811 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:09.151325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:09.151761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:09.152458 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:09.152951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:09.153382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:09.227840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:09.236076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-36f57fc8-78b3-409b-b407-cbc0155248df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1270 microversion: 2.1 time: 0.096183 Oct 04 10:39:09.236644 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 261/516] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:09 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:09.729252 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:09.730625 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:09.739702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:09.740327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:09.740981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:09.741688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:09.742141 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:09.742563 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:09.880258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:09.889166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-53bca5ca-4708-40a2-8ceb-d06071586529 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1723 microversion: 2.1 time: 0.164768 Oct 04 10:39:09.890091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 256/517] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:09 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:10.259591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:10.260241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:10.266963 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:10.267448 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:10.267888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:10.268593 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:10.269078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:10.269506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:10.347317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:10.355088 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-da17a3ac-6b82-40b0-b670-b12aa42783ed tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1278 microversion: 2.1 time: 0.099465 Oct 04 10:39:10.355680 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 262/518] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:10 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:10.738216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1414306385", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3777809b-2b97-4e60-ad42-7e512a3a37c4"}], "security_groups": [{"name": "tempest-securitygroup--1524690217"}], "key_name": "tempest-keypair-795972874", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:10.841353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] validate_networks() for [('3777809b-2b97-4e60-ad42-7e512a3a37c4', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:39:10.913671 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:10.914401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:10.920752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:10.921340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:10.921988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:10.922685 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:10.923296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:10.923913 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:11.059481 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:11.067535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d7c7dcd0-1fa0-4a70-9e78-95c16c254f30 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1723 microversion: 2.1 time: 0.157718 Oct 04 10:39:11.068114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 263/519] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:10 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:11.378443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:11.379055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:11.380109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:39:11.381268 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:39:11.381749 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:39:11.382777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:39:11.383201 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:39:11.386494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:11.386991 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:11.387426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:11.388289 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:11.389257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:11.389689 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:11.393419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:11.393901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:11.394559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:11.395425 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:11.395882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:11.396304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:11.414234 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for project 17e605186f7944a79d36288d99d1eaa9. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:39:11.418434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Getting quotas for user 3c7fcc99edab427aa2b750bf6b15b39c and project 17e605186f7944a79d36288d99d1eaa9. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:39:11.432785 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:39:11.436486 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:39:11.455331 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:11.463626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-28919dd2-7e94-4928-851d-e5c7a38b0a60 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1276 microversion: 2.1 time: 0.089170 Oct 04 10:39:11.464194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 264/520] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:11 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:11.636424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7699aa10-b602-422e-9834-616ca38ab380 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.902424 Oct 04 10:39:11.637180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 257/521] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 10:39:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 10:39:11.651688 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ad87e4db-9234-4a24-9b06-a85a61d18117 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:11.654781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ad87e4db-9234-4a24-9b06-a85a61d18117 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:11.722325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ad87e4db-9234-4a24-9b06-a85a61d18117 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:11.726812 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ad87e4db-9234-4a24-9b06-a85a61d18117 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:11.728309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ad87e4db-9234-4a24-9b06-a85a61d18117 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:11.729511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ad87e4db-9234-4a24-9b06-a85a61d18117 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1281 microversion: 2.20 time: 0.084731 Oct 04 10:39:11.730356 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 265/522] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:11 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:12.090674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:12.092920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:12.102466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.103113 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.103639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.104440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.104992 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.105554 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.403130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:12.411691 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7b77a7c3-ee14-4bb8-b962-5df8ca7b4a10 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1729 microversion: 2.1 time: 0.325163 Oct 04 10:39:12.412255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 258/523] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:12 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:12.437640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:12.438219 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:12.444653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.445161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.445592 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.446277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.446725 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.447141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.491204 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:12.492321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:12.507118 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:12.512109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.512828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.513448 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.514774 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.515447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.515919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.551846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7f6db27e-359a-4486-a3bc-17fd5a6769db tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118815 Oct 04 10:39:12.552571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 266/524] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:39:12 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:12.756286 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:12.757140 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:12.763701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.765215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.765655 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.766356 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:12.767008 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:12.767430 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:12.811948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:12.822747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9e3103b4-1dce-41d7-9b80-233e8dec9ba9 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.337059 Oct 04 10:39:12.828796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 259/525] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:12 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:12.840244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:12.854788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:12.856653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:12.859260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4398c0c4-a322-42ef-9892-779c4de6b519 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1285 microversion: 2.20 time: 0.107090 Oct 04 10:39:12.860123 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 267/526] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:12 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:39:13.352182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-9daf73c4-538e-4bae-b35f-364b703805d8 req-e774ae68-a44c-43b4-8939-5cf462566623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3be87b4-5b52-4be1-861b-44bafa867831", "tag": "9633d963-f8b9-4279-94fb-546950be618d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:13.367567 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-9daf73c4-538e-4bae-b35f-364b703805d8 req-e774ae68-a44c-43b4-8939-5cf462566623 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:13.368048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-9daf73c4-538e-4bae-b35f-364b703805d8 req-e774ae68-a44c-43b4-8939-5cf462566623 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:13.368512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-9daf73c4-538e-4bae-b35f-364b703805d8 req-e774ae68-a44c-43b4-8939-5cf462566623 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:13.382542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-9daf73c4-538e-4bae-b35f-364b703805d8 req-e774ae68-a44c-43b4-8939-5cf462566623 service nova] Creating event network-changed:9633d963-f8b9-4279-94fb-546950be618d for instance e3be87b4-5b52-4be1-861b-44bafa867831 on hv-cinder-85919 Oct 04 10:39:13.387905 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-9daf73c4-538e-4bae-b35f-364b703805d8 req-e774ae68-a44c-43b4-8939-5cf462566623 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040062 Oct 04 10:39:13.388526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 260/527] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:13.626335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-ef6adc9d-c672-472d-91d4-5e54414373f1 req-31f778ab-e3c8-40d8-91f8-93346fc8b3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2d2b30-9c51-470d-aa3b-edc245fff08b", "tag": "ec90e50c-fd6d-48b5-87e0-0ad3457c78dc"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:13.647092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ef6adc9d-c672-472d-91d4-5e54414373f1 req-31f778ab-e3c8-40d8-91f8-93346fc8b3d3 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:13.647583 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ef6adc9d-c672-472d-91d4-5e54414373f1 req-31f778ab-e3c8-40d8-91f8-93346fc8b3d3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:13.648010 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ef6adc9d-c672-472d-91d4-5e54414373f1 req-31f778ab-e3c8-40d8-91f8-93346fc8b3d3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:13.666023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-ef6adc9d-c672-472d-91d4-5e54414373f1 req-31f778ab-e3c8-40d8-91f8-93346fc8b3d3 service nova] Creating event network-changed:ec90e50c-fd6d-48b5-87e0-0ad3457c78dc for instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b on hv-cinder-85919 Oct 04 10:39:13.673318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-ef6adc9d-c672-472d-91d4-5e54414373f1 req-31f778ab-e3c8-40d8-91f8-93346fc8b3d3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050918 Oct 04 10:39:13.674136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 268/528] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:13.852765 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:13.853405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:13.860259 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:13.860749 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:13.861220 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:13.861920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:13.862379 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:13.862804 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:13.892488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:13.893217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:13.900275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:13.900884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:13.901465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:13.902238 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:13.902906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:13.903572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:13.972007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:13.982347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:13.984587 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:13.986003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5fab3885-3b5c-4e68-93a5-2ea4f2682ff6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1333 microversion: 2.20 time: 0.098631 Oct 04 10:39:13.987066 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 269/529] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:13 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:14.039372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:14.049123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1d6df9bd-7344-4210-bf2a-fe943be536a6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.200504 Oct 04 10:39:14.049892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 261/530] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:13 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:15.011832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:15.012623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:15.022047 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:15.022714 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:15.024265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:15.025806 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:15.026479 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:15.027034 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:15.071874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:15.072671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:15.083658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:15.084150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:15.084836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:15.085894 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:15.086509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:15.087090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:15.114507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:15.124075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:15.126023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:15.127399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-78ba9faa-da85-4dbe-9556-bf81badf2e4b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1339 microversion: 2.20 time: 0.119599 Oct 04 10:39:15.128181 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 270/531] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:15 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:15.428913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:15.437419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-20841bcd-83f8-40d9-ab74-6f06d8c24a06 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.369435 Oct 04 10:39:15.438401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 262/532] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:15 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:15.688656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-5da0fdc9-8bd5-49b8-88d6-2c56b6726848 req-dcbd1aa6-8ebc-4f4b-87ea-2ee317fd4d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2d2b30-9c51-470d-aa3b-edc245fff08b", "tag": "ec90e50c-fd6d-48b5-87e0-0ad3457c78dc"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:15.698428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5da0fdc9-8bd5-49b8-88d6-2c56b6726848 req-dcbd1aa6-8ebc-4f4b-87ea-2ee317fd4d1b service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:15.698909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5da0fdc9-8bd5-49b8-88d6-2c56b6726848 req-dcbd1aa6-8ebc-4f4b-87ea-2ee317fd4d1b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:15.699338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5da0fdc9-8bd5-49b8-88d6-2c56b6726848 req-dcbd1aa6-8ebc-4f4b-87ea-2ee317fd4d1b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:15.713382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-5da0fdc9-8bd5-49b8-88d6-2c56b6726848 req-dcbd1aa6-8ebc-4f4b-87ea-2ee317fd4d1b service nova] Creating event network-changed:ec90e50c-fd6d-48b5-87e0-0ad3457c78dc for instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b on hv-cinder-85919 Oct 04 10:39:15.719038 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-5da0fdc9-8bd5-49b8-88d6-2c56b6726848 req-dcbd1aa6-8ebc-4f4b-87ea-2ee317fd4d1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034160 Oct 04 10:39:15.722909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 271/533] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:16.154827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:16.155355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:16.161795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:16.162283 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:16.162726 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:16.163422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:16.163877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:16.164307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:16.297033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:16.305043 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:16.306494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:16.307600 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b3a3c36e-11f6-44ad-a895-6140b8f9ca92 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.156858 Oct 04 10:39:16.308153 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 263/534] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:16 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:16.469304 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:16.470546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:16.481072 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:16.481940 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:16.483371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:16.483997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:16.485281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:16.485636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:16.736185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:16.744186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-58be06ba-c03c-456e-a643-dd659554dec4 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.285492 Oct 04 10:39:16.744872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 272/535] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:16 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:17.333595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:17.334189 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:17.341062 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:17.341555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:17.342692 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:17.343453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:17.343911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:17.344338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:17.477150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:17.486048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:17.490405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:17.490405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cb42ceb4-694e-41df-a2d4-9dd0fd5b4d73 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.158967 Oct 04 10:39:17.490405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 264/536] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:17 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:17.738862 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-c305c354-83a9-4bcd-9426-5be37f74ca86 req-28d030f5-5e1a-4c8c-8e10-688529904f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefaea3d-478b-4401-a34c-74c864644738", "tag": "ff01017f-f507-44cb-a23c-fb625d92baba"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:17.743779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:17.750563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c305c354-83a9-4bcd-9426-5be37f74ca86 req-28d030f5-5e1a-4c8c-8e10-688529904f71 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:17.751207 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c305c354-83a9-4bcd-9426-5be37f74ca86 req-28d030f5-5e1a-4c8c-8e10-688529904f71 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:17.751632 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c305c354-83a9-4bcd-9426-5be37f74ca86 req-28d030f5-5e1a-4c8c-8e10-688529904f71 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:17.762881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-c305c354-83a9-4bcd-9426-5be37f74ca86 req-28d030f5-5e1a-4c8c-8e10-688529904f71 service nova] Creating event network-changed:ff01017f-f507-44cb-a23c-fb625d92baba for instance fefaea3d-478b-4401-a34c-74c864644738 on hv-cinder-85919 Oct 04 10:39:17.767081 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:17.767838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:17.769007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-c305c354-83a9-4bcd-9426-5be37f74ca86 req-28d030f5-5e1a-4c8c-8e10-688529904f71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 Oct 04 10:39:17.770388 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 273/537] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:17.774369 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:17.774858 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:17.775293 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:17.776001 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:17.776456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:17.776895 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:17.912144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:17.920642 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-94395d54-35b7-485b-ace8-fcc4e04c87e0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.157595 Oct 04 10:39:17.923153 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 265/538] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:17 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:18.515532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:18.516237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:18.522739 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:18.523226 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:18.523668 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:18.526413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:18.526413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:18.526413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:18.658116 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:18.666825 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:18.668210 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:18.669389 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-84b58d36-3181-4662-87c5-3409dcc8edfa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.159000 Oct 04 10:39:18.669943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 274/539] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:18 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:18.944546 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:18.945110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:18.951440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:18.951911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:18.952344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:18.953673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:18.954112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:18.954530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:19.087082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:19.090735 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:19.095279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ce046bcf-f01a-46a8-950d-137079976dd5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.154800 Oct 04 10:39:19.095856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 266/540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:18 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:19.103384 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-c91fd76c-70d8-463a-9f46-3fc69c3e3634 req-cbf941a3-a8f6-4576-9ead-015a39452ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3be87b4-5b52-4be1-861b-44bafa867831", "name": "network-vif-plugged", "status": "completed", "tag": "9633d963-f8b9-4279-94fb-546950be618d"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:19.113409 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c91fd76c-70d8-463a-9f46-3fc69c3e3634 req-cbf941a3-a8f6-4576-9ead-015a39452ae3 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:19.118821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c91fd76c-70d8-463a-9f46-3fc69c3e3634 req-cbf941a3-a8f6-4576-9ead-015a39452ae3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:19.118821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c91fd76c-70d8-463a-9f46-3fc69c3e3634 req-cbf941a3-a8f6-4576-9ead-015a39452ae3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:19.125485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-c91fd76c-70d8-463a-9f46-3fc69c3e3634 req-cbf941a3-a8f6-4576-9ead-015a39452ae3 service nova] Creating event network-vif-plugged:9633d963-f8b9-4279-94fb-546950be618d for instance e3be87b4-5b52-4be1-861b-44bafa867831 on hv-cinder-85919 Oct 04 10:39:19.130478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-c91fd76c-70d8-463a-9f46-3fc69c3e3634 req-cbf941a3-a8f6-4576-9ead-015a39452ae3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031200 Oct 04 10:39:19.131089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 275/541] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:19.694306 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:19.694908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:19.701152 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:19.701638 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:19.702070 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:19.702837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:19.703378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:19.703797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:19.842889 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:19.851480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:19.852945 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:19.854037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-12453d44-3802-4810-a995-6ce8e011e6f4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.164054 Oct 04 10:39:19.854593 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 267/542] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:19 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:39:20.119512 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:20.120197 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:20.127078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:20.127549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:20.127979 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:20.128660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:20.129160 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:20.129582 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:20.256513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:20.264118 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f6260cfb-bec5-46fb-bc4e-b4258e0e18bb tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.149002 Oct 04 10:39:20.264675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 276/543] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:20 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:20.880070 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:20.880607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:20.886968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:20.887460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:20.887887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:20.888572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:20.889056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:20.889486 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:21.020893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:21.028996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:21.031283 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:21.032955 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c043792b-950e-431b-ac3b-2f24405a25fc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.156809 Oct 04 10:39:21.033520 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 268/544] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:20 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:21.286447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:21.287061 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:21.293816 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:21.294303 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:21.294771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:21.295464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:21.295920 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:21.297621 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:21.312897 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:21.442396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:21.450055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8a87119d-f561-40b0-a6b4-5f66d578cffc tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1318 microversion: 2.1 time: 0.167441 Oct 04 10:39:21.450620 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 277/545] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:21 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:22.057897 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:22.058529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:22.060347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:22.061015 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=10 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:22.066933 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:22.067413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:22.067849 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:22.068529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:22.069015 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:22.069433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:22.201784 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:22.211084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:22.212507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:22.213621 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-231e165b-6845-4bf7-985c-fbed502063d5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.159700 Oct 04 10:39:22.214204 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 269/546] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:22 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:22.473489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:22.474106 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:22.476254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=12 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:22.481919 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:22.484931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:22.484931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:22.484931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:22.484931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:22.485281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:22.619154 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:22.626825 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-72d3869f-ed6d-49d5-b789-0fc0ab191f07 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1507 microversion: 2.1 time: 0.157211 Oct 04 10:39:22.627353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 278/547] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:22 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:23.156358 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-acb847e4-66f3-4c8b-9472-16fb20a9bfef req-3dc13f0a-03bc-4649-b0df-0f0f9214ddc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefaea3d-478b-4401-a34c-74c864644738", "name": "network-vif-plugged", "status": "completed", "tag": "ff01017f-f507-44cb-a23c-fb625d92baba"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:23.166262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-acb847e4-66f3-4c8b-9472-16fb20a9bfef req-3dc13f0a-03bc-4649-b0df-0f0f9214ddc8 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:23.166743 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-acb847e4-66f3-4c8b-9472-16fb20a9bfef req-3dc13f0a-03bc-4649-b0df-0f0f9214ddc8 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:23.167180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-acb847e4-66f3-4c8b-9472-16fb20a9bfef req-3dc13f0a-03bc-4649-b0df-0f0f9214ddc8 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:23.179619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-acb847e4-66f3-4c8b-9472-16fb20a9bfef req-3dc13f0a-03bc-4649-b0df-0f0f9214ddc8 service nova] Creating event network-vif-plugged:ff01017f-f507-44cb-a23c-fb625d92baba for instance fefaea3d-478b-4401-a34c-74c864644738 on hv-cinder-85919 Oct 04 10:39:23.184762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-acb847e4-66f3-4c8b-9472-16fb20a9bfef req-3dc13f0a-03bc-4649-b0df-0f0f9214ddc8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032086 Oct 04 10:39:23.185424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 270/548] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:23.239428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:23.240490 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:23.247597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:23.248265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:23.248914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:23.249864 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:23.250449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:23.251171 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:23.421972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:23.431021 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:23.432468 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:23.433597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4f324d8c-fc3e-48b2-bf8b-7564a6872e64 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.198991 Oct 04 10:39:23.434165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 279/549] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:23 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:24.460084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:24.460775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:24.466956 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:24.467437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:24.467870 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:24.468559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:24.469035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:24.469462 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:24.614305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:24.622979 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:24.624425 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:24.625555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3cf47f71-6548-41ba-ad31-f3f35ed6f13e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.171071 Oct 04 10:39:24.626115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 271/550] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:24 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:25.650913 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:25.651972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:25.659299 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:25.659715 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:25.660150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:25.660844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:25.661313 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:25.661731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:25.806935 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:25.816107 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:25.817755 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:25.819030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2653ac15-eb97-435f-b1c2-55f75d3a247a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1407 microversion: 2.20 time: 0.172148 Oct 04 10:39:25.819504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 280/551] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:25 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:26.845501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:26.846656 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:26.853279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:26.853759 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:26.854193 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:26.854880 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:26.855362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:26.855788 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:26.989112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:27.000197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:27.002630 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:27.004427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e474ba2f-f722-41a8-ba02-53f9c7374c6b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1597 microversion: 2.20 time: 0.162612 Oct 04 10:39:27.005283 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 272/552] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:39:26 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:39:27.039722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:27.040304 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:27.046596 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:27.047081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:27.047597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:27.048317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:27.048787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:27.049239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:27.135887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-eac8ace0-fc13-4dd1-aeb8-c2e1377e38dc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100918 Oct 04 10:39:27.136485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 281/553] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 10:39:27 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:39:28.195733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-4d80c2f9-a7ec-462b-b2c3-4cff21411e2b req-d69c7668-499d-4ec9-8c67-3d202a4d836b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefaea3d-478b-4401-a34c-74c864644738", "tag": "ff01017f-f507-44cb-a23c-fb625d92baba"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:28.205463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4d80c2f9-a7ec-462b-b2c3-4cff21411e2b req-d69c7668-499d-4ec9-8c67-3d202a4d836b service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:28.205938 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4d80c2f9-a7ec-462b-b2c3-4cff21411e2b req-d69c7668-499d-4ec9-8c67-3d202a4d836b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:28.206366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4d80c2f9-a7ec-462b-b2c3-4cff21411e2b req-d69c7668-499d-4ec9-8c67-3d202a4d836b service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:28.222007 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-4d80c2f9-a7ec-462b-b2c3-4cff21411e2b req-d69c7668-499d-4ec9-8c67-3d202a4d836b service nova] Creating event network-changed:ff01017f-f507-44cb-a23c-fb625d92baba for instance fefaea3d-478b-4401-a34c-74c864644738 on hv-cinder-85919 Oct 04 10:39:28.228443 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-4d80c2f9-a7ec-462b-b2c3-4cff21411e2b req-d69c7668-499d-4ec9-8c67-3d202a4d836b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036881 Oct 04 10:39:28.229182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 273/554] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:34.051649 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:34.052243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:34.054110 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:34.058802 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:34.059287 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:34.059729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:34.060424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:34.060906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:34.061340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:34.085704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4fa2e28f-2d13-4b58-8cb8-7a643378f3f4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/ips" status: 200 len: 150 microversion: 2.1 time: 0.039197 Oct 04 10:39:34.086599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 282/555] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:39:34 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:35.700592 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dacb9b9b-0f59-4caf-9133-b967d3bd13e5"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:35.703049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:35.710304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:35.710829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:35.711266 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:35.711957 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:35.712411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:35.712835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:36.522994 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-eafd8be0-f5f7-4141-901f-39c4472e493c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.826415 Oct 04 10:39:36.523524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 274/556] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:39:35 2022] POST /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:41.301382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c257a48-cc20-4bab-8f4f-2bc852ce06db", "device": "/dev/sdb"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:41.304285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:41.311192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:41.311663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:41.312092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:41.312774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:41.313313 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:41.313693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:41.997450 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5eb6baf3-1964-49ee-88f7-c56a381f614e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "POST /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699708 Oct 04 10:39:42.003075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 283/557] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:39:41 2022] POST /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:45.126928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dacb9b9b-0f59-4caf-9133-b967d3bd13e5"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:45.129779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:45.134527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=32 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:45.138214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:45.138681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:45.139184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:45.139901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:45.140343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:45.140762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:45.223276 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Invalid volume: volume dacb9b9b-0f59-4caf-9133-b967d3bd13e5 is already attached to instances: 719e90e9-ee4b-4132-8f1c-c29c32a37bac Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments HTTP/1.1 Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 74 Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:39:45.225137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {"volumeAttachment": {"volumeId": "dacb9b9b-0f59-4caf-9133-b967d3bd13e5"}} Oct 04 10:39:45.226518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Invalid volume: volume dacb9b9b-0f59-4caf-9133-b967d3bd13e5 is already attached to instances: 719e90e9-ee4b-4132-8f1c-c29c32a37bac Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'server_id': '719e90e9-ee4b-4132-8f1c-c29c32a37bac', 'body': {'volumeAttachment': {'volumeId': 'dacb9b9b-0f59-4caf-9133-b967d3bd13e5'}}} Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dacb9b9b-0f59-4caf-9133-b967d3bd13e5 is already attached to instances: 719e90e9-ee4b-4132-8f1c-c29c32a37bac Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:45.227340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dacb9b9b-0f59-4caf-9133-b967d3bd13e5 is already attached to instances: 719e90e9-ee4b-4132-8f1c-c29c32a37bac Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:39:45.229024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dacb9b9b-0f59-4caf-9133-b967d3bd13e5 is already attached to instances: 719e90e9-ee4b-4132-8f1c-c29c32a37bac Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 400 to user: Invalid volume: volume dacb9b9b-0f59-4caf-9133-b967d3bd13e5 is already attached to instances: 719e90e9-ee4b-4132-8f1c-c29c32a37bac {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c92172b6-d19d-451b-93bc-8dba60fd1a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104151 Oct 04 10:39:45.230758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 275/558] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:39:45 2022] POST /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:39:45.329232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:45.329813 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:45.337215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:45.337708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:45.338149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:45.338846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:45.339304 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:45.339734 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:45.420677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lazy-loading 'services' on Instance uuid 719e90e9-ee4b-4132-8f1c-c29c32a37bac {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:39:45.631847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-de70879b-7d80-4c58-b267-4b9334e8f7c4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments/dacb9b9b-0f59-4caf-9133-b967d3bd13e5" status: 202 len: 0 microversion: 2.1 time: 0.306833 Oct 04 10:39:45.632440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 284/559] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:39:45 2022] DELETE /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments/dacb9b9b-0f59-4caf-9133-b967d3bd13e5 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:39:45.640641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:45.642812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:45.649401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:45.649893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:45.650330 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:45.651030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:45.651487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:45.651914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:45.682310 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2c206452-611a-4454-bc43-dfdcf914fab4 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Oct 04 10:39:45.682874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 276/560] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:45 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:46.696622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:46.698958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:46.705070 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:46.705553 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:46.705990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:46.706674 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:46.707123 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:46.707541 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:46.737358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4181f800-80d1-4f18-9682-dd70a985c20c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045764 Oct 04 10:39:46.737908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 285/561] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:46 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:39:47.749947 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:47.752078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:47.758612 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:47.759087 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:47.759518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:47.760255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:47.760702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:47.761151 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:47.789616 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-084d5201-f5f2-4dde-a12c-7167591b3ad3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Oct 04 10:39:47.790155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 277/562] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:47 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:48.802055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:48.804195 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:48.810521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:48.810994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:48.811425 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:48.812097 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:48.812539 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:48.812980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:48.843902 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-45b18333-184b-4297-9572-36b47c5a6778 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Oct 04 10:39:48.844443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 286/563] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:48 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:49.856173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:49.858357 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:49.865387 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:49.865865 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:49.866296 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:49.867017 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:49.867428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:49.867829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:49.870197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:49.897434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c17853f3-8a3e-4c7a-a8b3-61b3e98514cb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045188 Oct 04 10:39:49.897973 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 278/564] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:49 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:50.909804 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:50.913302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:50.919787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:50.920266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:50.920705 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:50.921417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:50.921872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:50.922289 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:50.951826 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-415eb743-1374-407a-82f0-889aa87a2593 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045981 Oct 04 10:39:50.952379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 287/565] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:50 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:51.595589 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:51.601129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:51.610628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:51.615827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:51.615827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:51.615827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:51.615827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:51.617616 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:51.654577 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-36285166-f8b7-48e1-96ea-5a7512b964a3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063411 Oct 04 10:39:51.655157 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 279/566] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:51 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:39:51.719659 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:51.720092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:51.726648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:51.729141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:51.729141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:51.729141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:51.729141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:51.729554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:51.753854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:39:51.964891 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:51.967040 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:51.974359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:51.974954 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:51.975388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:51.976068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:51.976516 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:51.976962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:52.006898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9269c5d5-1948-488d-8973-acc783565617 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Oct 04 10:39:52.007450 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 280/567] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:51 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:39:52.049766 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-07db012f-4225-4164-a090-689861c1f5f0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 204 len: 0 microversion: 2.1 time: 0.333715 Oct 04 10:39:52.050380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 288/568] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:39:51 2022] DELETE /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:39:52.058691 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:52.059298 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:52.065536 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:52.066031 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:52.066446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:52.067352 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:52.067807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:52.068253 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:52.206634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:52.215435 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ed574877-8a35-4778-bd20-bb91dbde13a7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1674 microversion: 2.1 time: 0.160568 Oct 04 10:39:52.216023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 281/569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:52 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:53.020237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:53.022607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:53.029059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:53.029536 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:53.030000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:53.030726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:53.031170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:53.031588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:53.036587 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:53.063116 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-54859c04-9f50-4509-ad6c-f0dcdefc3c6e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047351 Oct 04 10:39:53.063765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 289/570] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:53 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:53.241539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:53.242236 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:53.251245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:53.251245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:53.251245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:53.251245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:53.251552 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:53.251552 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:53.392934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:53.401179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9ea6cf83-7f46-46c0-bb4e-3823c76794f6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1674 microversion: 2.1 time: 0.165853 Oct 04 10:39:53.401847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 282/571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:53 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:54.076413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:54.078575 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:54.086640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.087126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.087565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.088250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.088760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.089208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.121685 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ba706f97-e306-4e79-ab80-f223db052b3a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049372 Oct 04 10:39:54.122372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 290/572] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:54 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:54.351112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:54.351639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:54.358101 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.358630 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.359099 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.359828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.360287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.360714 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.425583 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:54.426196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:54.433547 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.434251 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.434817 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.435740 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.436315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.436743 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.439801 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'services' on Instance uuid 2a2d2b30-9c51-470d-aa3b-edc245fff08b {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:39:54.569993 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:54.578176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fddd1b32-5c4e-40db-baa8-4be9f701867f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1674 microversion: 2.1 time: 0.156706 Oct 04 10:39:54.579932 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 291/573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:54 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:54.644152 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f4b15175-56fd-47b3-9124-df0504c5b697 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments/37d6485b-cf57-490d-bcd6-6d7756c7f336" status: 202 len: 0 microversion: 2.1 time: 0.297816 Oct 04 10:39:54.645161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 283/574] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:39:54 2022] DELETE /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments/37d6485b-cf57-490d-bcd6-6d7756c7f336 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:39:54.653854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:54.656086 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:54.663199 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.663671 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.664159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.664786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:54.665266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:54.665684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:54.699275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6f89697e-a9ad-4499-b248-34673270b25c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049585 Oct 04 10:39:54.699824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 292/575] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:54 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:55.135304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:55.137705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:55.143915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:55.144397 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:55.144945 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:55.145566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:55.146017 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:55.146444 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:55.177521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-53a0c640-141e-4902-b65a-e3e7c0cd27d5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046469 Oct 04 10:39:55.178074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 284/576] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:55 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:55.603716 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:55.604323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:55.611074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:55.611554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:55.611994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:55.612681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:55.613234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:55.613669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:55.712582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:55.715456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:55.723036 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:55.724737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:55.724737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:55.725236 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:55.725689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:55.726110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:55.750075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:55.758013 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6a1275ad-6e99-4ae4-b207-e367b6a668fa tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1674 microversion: 2.1 time: 0.158235 Oct 04 10:39:55.761419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-18f70687-2b09-4d20-aeac-be69ad6f9ed8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050423 Oct 04 10:39:55.761561 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 293/577] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:55 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:55.761667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 285/578] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:55 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:39:56.189443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:56.191565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:56.198081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:56.198558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:56.198991 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:56.199666 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:56.200108 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:56.200522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:56.229595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6a4e30fe-c1b0-47af-b934-42f8a5f14727 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Oct 04 10:39:56.230120 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 294/579] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:56 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:56.776441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:56.779030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:56.781904 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:56.782550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:56.786160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:56.786815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:56.787254 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:56.787968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:56.788410 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:56.788830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:56.789435 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:56.789915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:56.790355 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:56.791276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:56.791752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:56.792191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:56.825089 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0e5a9456-0e39-472f-ad73-2e485f11251c tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053918 Oct 04 10:39:56.825662 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 286/580] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:56 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:57.243361 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:57.245716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:57.246146 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:57.251893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:57.253009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:57.253458 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:57.253876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-55ee6af6-01ee-4b68-9e4b-82e0525fbb98 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1674 microversion: 2.1 time: 0.475845 Oct 04 10:39:57.254170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:57.254694 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:57.255125 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:57.259133 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 295/581] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:56 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1674 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:57.289838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d617b4e3-6e0a-48ab-b140-adbbbe7950e1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052067 Oct 04 10:39:57.290407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 287/582] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:57 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:39:57.839105 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:57.841784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:57.849087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:57.850731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:57.851483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:57.852413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:57.853374 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:57.853841 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:57.916088 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f86275fb-753c-444a-a17c-c42d563ec228 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081940 Oct 04 10:39:57.916651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 296/583] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:57 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:58.197176 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-aab3831f-2f5e-4e6a-93c4-c486221ea820 req-a67288bf-6b39-452f-ae47-96392976e3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeea5c57-433b-4799-9515-799453a51522", "name": "network-vif-deleted", "tag": "3fe6667c-b24b-4c09-81d9-fd02d2113f4d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:39:58.209128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-aab3831f-2f5e-4e6a-93c4-c486221ea820 req-a67288bf-6b39-452f-ae47-96392976e3d7 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.210068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-aab3831f-2f5e-4e6a-93c4-c486221ea820 req-a67288bf-6b39-452f-ae47-96392976e3d7 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.211037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-aab3831f-2f5e-4e6a-93c4-c486221ea820 req-a67288bf-6b39-452f-ae47-96392976e3d7 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.225020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-aab3831f-2f5e-4e6a-93c4-c486221ea820 req-a67288bf-6b39-452f-ae47-96392976e3d7 service nova] Creating event network-vif-deleted:3fe6667c-b24b-4c09-81d9-fd02d2113f4d for instance eeea5c57-433b-4799-9515-799453a51522 on hv-cinder-85919 Oct 04 10:39:58.230056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-aab3831f-2f5e-4e6a-93c4-c486221ea820 req-a67288bf-6b39-452f-ae47-96392976e3d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038039 Oct 04 10:39:58.235620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 288/584] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:39:58.278513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:58.279294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:58.285998 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.287612 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.288321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.289365 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.290046 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.290691 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.305191 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:58.307825 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:58.325256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.325778 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.326219 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.326937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.330229 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.332093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.373190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f89a5888-d851-45f4-af69-52fd81ce0a2b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073986 Oct 04 10:39:58.379002 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 289/585] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:58 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:39:58.394252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:58.408695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c2c5f27c-2122-4ae9-bf78-dcaec789c9c3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1606 microversion: 2.1 time: 0.134346 Oct 04 10:39:58.417990 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 297/586] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:58 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1606 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:58.465023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:58.465529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:58.471505 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.471873 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.472310 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.473030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.474124 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.474645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.502362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:39:58.855331 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6d46a7d1-cd71-4472-9121-c80905a27839 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 204 len: 0 microversion: 2.1 time: 0.393971 Oct 04 10:39:58.856218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 290/587] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:39:58 2022] DELETE /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:39:58.865675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:58.866432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:58.873311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.873799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.874235 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.874933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.875420 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.875855 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.934214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:58.936603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:58.954129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.954617 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.955050 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.955758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:58.956206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:58.956623 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:58.990311 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7f7b6add-c178-4485-ac90-e023e713aeba tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060246 Oct 04 10:39:58.990892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 291/588] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:39:58 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:39:59.024778 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:59.033151 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9a21d882-32dc-46b3-8083-e5a9de80ecc5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1682 microversion: 2.1 time: 0.172483 Oct 04 10:39:59.034046 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 298/589] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:58 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:39:59.078609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:59.079166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:59.086214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:59.086765 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:59.087401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:59.088363 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:59.088944 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:59.089645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:59.119337 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:39:59.133417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:59.435761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:59.436473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:59.438009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2fc03088-0c1e-4d63-bf6b-413d82b54231 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 204 len: 0 microversion: 2.1 time: 0.362998 Oct 04 10:39:59.438854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 292/590] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:39:59 2022] DELETE /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:39:59.444358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:59.444954 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:59.445498 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:59.446266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:59.446732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:59.447157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:59.447696 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:39:59.448404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:39:59.454681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:59.455163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:59.455605 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:59.456302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:39:59.456759 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:39:59.457221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:39:59.511944 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:59.519122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-027f353b-5ee9-405d-a3c9-dfd5e607bb2e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1322 microversion: 2.1 time: 0.088439 Oct 04 10:39:59.519932 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 299/591] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:59 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:39:59.599659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:39:59.607441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b52fc8dd-aaa2-47ce-897c-76444e4a589e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1689 microversion: 2.1 time: 0.163966 Oct 04 10:39:59.607998 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 293/592] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:39:59 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:00.056964 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:00.057587 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:00.063971 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:00.064447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:00.064898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:00.065593 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:00.066046 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:00.066473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:00.193283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:00.200957 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-db438515-d2d6-4a94-b21e-4acc6a4bf146 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1682 microversion: 2.1 time: 0.147827 Oct 04 10:40:00.201521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 300/593] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:00 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:00.543340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:00.543947 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:00.550304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:00.550781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:00.551333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:00.552079 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:00.552544 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:00.552983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:00.618257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:00.626300 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1b3d095c-df51-4fed-b21a-8ba7693ea01d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1322 microversion: 2.1 time: 0.086796 Oct 04 10:40:00.626855 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 294/594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:00 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:00.633031 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:00.633589 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:00.640279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:00.640770 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:00.641256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:00.642001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:00.642469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:00.642895 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:00.774488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:00.782159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a2cd6d54-7bea-4a9e-b295-c1b918456836 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1689 microversion: 2.1 time: 0.154552 Oct 04 10:40:00.782732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 301/595] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:00 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:01.226862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:01.227475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:01.233344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:01.233836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:01.234272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:01.235106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:01.235667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:01.236325 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:01.372448 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:01.382058 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3b0de3ea-e102-4237-914c-89ee81786f1e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1682 microversion: 2.1 time: 0.160479 Oct 04 10:40:01.382628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 295/596] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:01 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:01.649380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:01.650020 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:01.656944 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:01.657429 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:01.657858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:01.658544 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:01.659033 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:01.659442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:01.697697 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:01.699834 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:01.703249 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:01.703905 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'fault' on Instance uuid eeea5c57-433b-4799-9515-799453a51522 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:01.747260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:01.755850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8cc35a08-0a45-4bd9-9404-40bf8562f74f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1327 microversion: 2.1 time: 0.111063 Oct 04 10:40:01.756414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 302/597] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:01 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:01.805333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:01.805945 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:01.813044 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:01.813495 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:01.814218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:01.815433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:01.816221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:01.816785 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:01.984015 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:01.994697 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f282b09b-df6a-4551-9a6d-69b9fd99cced tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1689 microversion: 2.1 time: 0.193213 Oct 04 10:40:01.995512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 296/598] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:01 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:02.408213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:02.409286 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:02.415693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:02.416178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:02.416610 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:02.417337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:02.417785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:02.418203 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:02.605859 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:02.619005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3e5eb3db-280a-46bd-96cc-d97abd03b86b tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1682 microversion: 2.1 time: 0.213888 Oct 04 10:40:02.619005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 303/599] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:02 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:02.780975 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:02.781585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:02.787734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:02.788294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:02.788733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:02.789456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:02.789913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:02.790343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:02.824825 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:02.825496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:02.825762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:02.826209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'fault' on Instance uuid eeea5c57-433b-4799-9515-799453a51522 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:02.867306 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:02.875168 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa3d8950-fdd4-4828-b53b-c393691d6628 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1327 microversion: 2.1 time: 0.098332 Oct 04 10:40:02.875738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 297/600] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:02 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:03.029723 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:03.030339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:03.036896 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:03.037357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:03.037793 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:03.038491 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:03.038943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:03.039366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:03.177721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:03.185711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1ba5c41b-f07f-46a6-b1f9-c1c3add575a8 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1689 microversion: 2.1 time: 0.159891 Oct 04 10:40:03.186273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 304/601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:03 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:03.648794 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:03.649437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:03.655325 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:03.655797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:03.656227 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:03.656966 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:03.657417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:03.657835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:03.790305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:03.797987 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6d0cbf93-4b20-4824-8694-911bfb4cfc21 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1682 microversion: 2.1 time: 0.153167 Oct 04 10:40:03.798548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 298/602] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:03 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:03.899557 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:03.900087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:03.906016 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:03.906498 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:03.906936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:03.907622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:03.908076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:03.908501 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:03.924114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:03.941233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:03.941712 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:03.942672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:03.943114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'fault' on Instance uuid eeea5c57-433b-4799-9515-799453a51522 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:03.984404 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:03.992499 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-44a634e6-6734-49ad-8a40-24f487e8b033 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1327 microversion: 2.1 time: 0.097894 Oct 04 10:40:03.993097 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 305/603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:03 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:04.211129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:04.211677 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:04.218343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:04.218823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:04.219254 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:04.219936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:04.220384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:04.220802 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:04.475434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:04.483427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f56e910f-095b-423c-ba0f-8e078d02ad23 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1689 microversion: 2.1 time: 0.277130 Oct 04 10:40:04.483990 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 299/604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:04 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1689 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:04.821663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:04.822272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:04.828743 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:04.829319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:04.829758 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:04.830446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:04.830905 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:04.831330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:05.011167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:05.015570 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:05.016172 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:05.018822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-17735d8d-ad4f-439f-8c3c-07e153a3eeee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1682 microversion: 2.1 time: 0.201024 Oct 04 10:40:05.019387 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 306/605] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:04 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:05.022835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:05.023411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:05.023915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:05.024679 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:05.025234 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:05.025744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:05.056910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:05.057389 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:05.057824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:05.058266 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'fault' on Instance uuid eeea5c57-433b-4799-9515-799453a51522 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:05.099175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:05.107197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5c0614aa-c855-42af-8761-4d27698eacae tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1327 microversion: 2.1 time: 0.095498 Oct 04 10:40:05.107767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 300/606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:05 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:05.506736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:05.507356 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:05.513353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:05.513840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:05.514277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:05.514971 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:05.515422 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:05.515845 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:05.643025 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:05.651613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8509508a-0e73-462e-859a-8ea3a984ad35 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1689 microversion: 2.1 time: 0.148870 Oct 04 10:40:05.652180 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 307/607] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:05 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:06.042440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:06.043075 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:06.049451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:06.049964 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:06.050399 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:06.051653 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:06.052185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:06.052521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:06.131612 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:06.132225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:06.138275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:06.138761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:06.139193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:06.139886 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:06.140328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:06.140745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:06.172195 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:06.172681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:06.173142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:06.173781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'fault' on Instance uuid eeea5c57-433b-4799-9515-799453a51522 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:06.190612 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:06.199424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-23f91878-d1c3-499e-8401-12c979dcba6d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1682 microversion: 2.1 time: 0.160864 Oct 04 10:40:06.199996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 301/608] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:06 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:06.216001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:06.223863 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c9c6231f-4b14-4859-81d2-c12c23d85e46 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1327 microversion: 2.1 time: 0.096933 Oct 04 10:40:06.224427 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:06 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:06.675932 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:06.677645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:06.684537 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:06.685060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:06.685935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:06.686221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:06.686671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:06.687214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:06.973374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:06.983618 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-289176bb-8f81-4a8f-af43-3367347787d5 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1689 microversion: 2.1 time: 0.311861 Oct 04 10:40:06.990285 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 302/610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:06 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1689 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:07.233174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:07.233174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:07.233174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:07.234198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:07.234840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:07.235763 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:07.236396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:07.236999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:07.248454 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:07.249097 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:07.260791 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:07.266817 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:07.266817 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:07.266817 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:07.266817 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:07.267266 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:07.305036 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:07.305522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:07.305961 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:07.306414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'fault' on Instance uuid eeea5c57-433b-4799-9515-799453a51522 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:07.328735 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:07.344650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f2234741-a4d1-4fa4-a04e-8664a7bc53a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1614 microversion: 2.1 time: 0.124934 Oct 04 10:40:07.346285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 309/611] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:07 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1614 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:07.384597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:07.391778 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a665074a-f548-4dda-8053-70304bb65c09 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 200 len: 1327 microversion: 2.1 time: 0.148518 Oct 04 10:40:07.392347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 303/612] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:07 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 1327 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:07.512403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-1020a317-3cc9-4e5d-964d-53df4567716e req-b32557db-005e-4b28-814d-1ec881fe112c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719e90e9-ee4b-4132-8f1c-c29c32a37bac", "name": "network-vif-deleted", "tag": "5293be1e-a131-4d90-a1e1-46554bf2e131"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:07.524396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-1020a317-3cc9-4e5d-964d-53df4567716e req-b32557db-005e-4b28-814d-1ec881fe112c service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:07.526858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-1020a317-3cc9-4e5d-964d-53df4567716e req-b32557db-005e-4b28-814d-1ec881fe112c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:07.526858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-1020a317-3cc9-4e5d-964d-53df4567716e req-b32557db-005e-4b28-814d-1ec881fe112c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:07.548788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-1020a317-3cc9-4e5d-964d-53df4567716e req-b32557db-005e-4b28-814d-1ec881fe112c service nova] Creating event network-vif-deleted:5293be1e-a131-4d90-a1e1-46554bf2e131 for instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac on hv-cinder-85919 Oct 04 10:40:07.557160 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-1020a317-3cc9-4e5d-964d-53df4567716e req-b32557db-005e-4b28-814d-1ec881fe112c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049390 Oct 04 10:40:07.578833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 310/613] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:07.871057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-abe391f4-fbde-4e69-8e18-33e817bfc6db req-eed129e6-60ff-4444-b50b-020fb597c2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2d2b30-9c51-470d-aa3b-edc245fff08b", "name": "network-vif-deleted", "tag": "ec90e50c-fd6d-48b5-87e0-0ad3457c78dc"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:07.886303 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-abe391f4-fbde-4e69-8e18-33e817bfc6db req-eed129e6-60ff-4444-b50b-020fb597c2b4 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:07.886819 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-abe391f4-fbde-4e69-8e18-33e817bfc6db req-eed129e6-60ff-4444-b50b-020fb597c2b4 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:07.887249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-abe391f4-fbde-4e69-8e18-33e817bfc6db req-eed129e6-60ff-4444-b50b-020fb597c2b4 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:07.900156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-abe391f4-fbde-4e69-8e18-33e817bfc6db req-eed129e6-60ff-4444-b50b-020fb597c2b4 service nova] Creating event network-vif-deleted:ec90e50c-fd6d-48b5-87e0-0ad3457c78dc for instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b on hv-cinder-85919 Oct 04 10:40:07.906322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-abe391f4-fbde-4e69-8e18-33e817bfc6db req-eed129e6-60ff-4444-b50b-020fb597c2b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043582 Oct 04 10:40:07.907385 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 304/614] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:08.010382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:08.013941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:08.022839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:08.023535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:08.024154 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:08.027156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:08.027832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:08.028972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:08.134204 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:08.148805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-096ff799-6479-403f-ae38-c8e55e2ad6ee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1331 microversion: 2.1 time: 0.142331 Oct 04 10:40:08.149551 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 311/615] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:08 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:08.370619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:08.371925 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:08.380268 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:08.381164 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:08.381819 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:08.382582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:08.383042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:08.383472 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:08.416137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:08.416822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:08.420426 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:08.421274 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:08.423558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:08.423558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lazy-loading 'fault' on Instance uuid 719e90e9-ee4b-4132-8f1c-c29c32a37bac {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:08.424554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:08.425185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:08.426533 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:08.427474 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:08.427954 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:08.428386 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:08.447256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] HTTP exception thrown: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Request method failure captured: Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 HTTP/1.1 Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxnCP0mu4XX_NSFtjgQtOqgNxcYqnTejerClrO16msVwW6XASAZ0XEuNzRHKYmhKbknOO7UiyoGJJyZiwdJQKmwURvSzUDq-I2hA9F_CrZXxTngro_QLf3kyz4taY6sy1SU0osrYOlCpsAtICItbIlcU8pRFIC1E65JYudjRgXmWFE Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:40:08.454742 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7857413ab9f24988bde94f9bf52b76a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 3008efcf02c644e3bc09850d6bd6eb63 Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:40:08.456876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'eeea5c57-433b-4799-9515-799453a51522'} Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:08.458048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:40:08.459311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:08.460748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Returning 404 to user: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:08.460748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-530ffcb5-9ff5-4de0-97b7-4f6228b9bf7f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 404 len: 111 microversion: 2.1 time: 0.038519 Oct 04 10:40:08.460748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 312/616] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:08 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:40:08.466889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-173e1ff0-495a-45a1-871d-f3aec97d2e90 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '.version_select at 0x7f9be9366ca0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:08.476477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:08.484755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-eb467a74-69fa-47b6-a549-e389200f6d35 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 200 len: 1331 microversion: 2.1 time: 0.118756 Oct 04 10:40:08.485374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 305/617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:08 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:08.550064 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-173e1ff0-495a-45a1-871d-f3aec97d2e90 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-236201382" status: 202 len: 0 microversion: 2.1 time: 0.087236 Oct 04 10:40:08.551839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 313/618] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 10:40:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-236201382 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:40:09.176872 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:09.178157 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:09.191687 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:09.192316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:09.193021 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:09.195264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:09.196797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:09.198105 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:09.239167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:09.239666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:09.240108 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:09.240567 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid 2a2d2b30-9c51-470d-aa3b-edc245fff08b {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:09.284019 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:09.295587 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-03ebd8a2-4b61-42c7-82ae-1b4fb5bb3d60 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 200 len: 1336 microversion: 2.1 time: 0.123566 Oct 04 10:40:09.296248 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 306/619] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:09 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:09.510435 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:09.511172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:09.518784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:09.519329 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:09.520336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:09.521125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:09.521580 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:09.522007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:09.535635 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac HTTP/1.1 Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:40:09.537311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:40:09.538820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '719e90e9-ee4b-4132-8f1c-c29c32a37bac'} Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:09.539579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:40:09.540718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:09.541831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:09.541831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-673b0075-7e88-472f-8182-ba6be48b6d16 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 404 len: 111 microversion: 2.1 time: 0.032152 Oct 04 10:40:09.541831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 314/620] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:09 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:40:09.547717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-659adab5-138c-478c-b5ca-7943de5bf628 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '.version_select at 0x7f9be952b310>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:09.662745 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-659adab5-138c-478c-b5ca-7943de5bf628 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363245923" status: 202 len: 0 microversion: 2.1 time: 0.118511 Oct 04 10:40:09.663325 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 307/621] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 10:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363245923 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:40:09.756481 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-20d9ac4a-c069-44ed-a3c2-f47795202b7a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'create', calling method: .version_select at 0x7f9be9366d30>, body: {"keypair": {"name": "tempest-keypair-1310980637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUElr+TvMW+hFM/BgANLRarf1mixnunLk8Wum44gLhkilRoQObCek5j3rX9N2962CwuPr0nBoaqJyOEKku1HNFagbw4trXtgznjPc58JqOn89lKU3brN/IS00D9BoMDLA=="}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:09.774044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-20d9ac4a-c069-44ed-a3c2-f47795202b7a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:40:09.778579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-20d9ac4a-c069-44ed-a3c2-f47795202b7a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for user 3008efcf02c644e3bc09850d6bd6eb63 and project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:40:09.862657 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-20d9ac4a-c069-44ed-a3c2-f47795202b7a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111754 Oct 04 10:40:09.864090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 315/622] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:40:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:10.319676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:10.320298 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 2a2d2b30-9c51-470d-aa3b-edc245fff08b] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:10.326300 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:10.326783 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:10.327220 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:10.327909 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:10.328368 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:10.328807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:10.331460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:10.344483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] HTTP exception thrown: Instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b could not be found. Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Request method failure captured: Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b HTTP/1.1 Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxrmNYd0EZ-22UGk_kKNY6-0U_YRbMfiBo-fxh7FZTtqb9rUroRPcVLUU-SbHpoTBcklmVbnvHkoYEQdtmLGXc7YkGQnXycCpMq6KhWtCeEcQxXaTCbjv5IgzPz4dGOSeijd4m0FZuRhHTH7qqPMbzi5nZUEFx_XbtAY9B33MXP2Vc Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:40:10.345637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e94e5705bcfd476e87b2fa0af6ff597a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: c4f4844eb5e14d789476cfb44e2516f0 Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b could not be found. Oct 04 10:40:10.347180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '2a2d2b30-9c51-470d-aa3b-edc245fff08b'} Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b could not be found. Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:10.347978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b could not be found. Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b could not be found. Oct 04 10:40:10.349733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:10.350781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Returning 404 to user: Instance 2a2d2b30-9c51-470d-aa3b-edc245fff08b could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:10.350781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-53f8315a-4124-43f2-b479-14c11e7f373b tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b" status: 404 len: 111 microversion: 2.1 time: 0.032011 Oct 04 10:40:10.350781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 308/623] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:10 2022] GET /compute/v2.1/servers/2a2d2b30-9c51-470d-aa3b-edc245fff08b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:40:10.356576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7f4c2004-32be-451a-8b02-5cb350ac416f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '.version_select at 0x7f9be93ddb80>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:10.369818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:10.370322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:10.376402 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:10.376925 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:10.377359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:10.378052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:10.378667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:10.379035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:10.446931 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7f4c2004-32be-451a-8b02-5cb350ac416f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402385389" status: 202 len: 0 microversion: 2.1 time: 0.094244 Oct 04 10:40:10.452911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 316/624] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 10:40:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402385389 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:40:10.471143 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lazy-loading 'services' on Instance uuid e3be87b4-5b52-4be1-861b-44bafa867831 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:10.535765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a0dbe72a-7b4f-4452-aca5-6a439e8857eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: .version_select at 0x7f9be965c4c0>, body: {"keypair": {"name": "tempest-keypair-1245436048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBALUci3TMKizJSLqJXNNwAF7DZCJaycXjnH9FXy4a8JXDm9zJfwqqHzW+OH6HaFQODX/wQfiVpwW1IbsU4MQdxEJuPEX57ap0jOZtmaQQyc133g9T3K5cecyu+i3QNQEg=="}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:10.557341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-a0dbe72a-7b4f-4452-aca5-6a439e8857eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:40:10.559779 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:10.561909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-a0dbe72a-7b4f-4452-aca5-6a439e8857eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:40:10.663803 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a0dbe72a-7b4f-4452-aca5-6a439e8857eb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131577 Oct 04 10:40:10.667036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 317/625] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:40:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:10.774469 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d7fd6d18-d6c7-4dd1-9c4c-ec1ab575f879 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831/os-volume_attachments/9c257a48-cc20-4bab-8f4f-2bc852ce06db" status: 202 len: 0 microversion: 2.1 time: 0.409083 Oct 04 10:40:10.775382 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 309/626] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:40:10 2022] DELETE /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831/os-volume_attachments/9c257a48-cc20-4bab-8f4f-2bc852ce06db => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:40:12.981768 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:12.982895 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:12.990038 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:12.990523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:12.990959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:12.991844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:12.992299 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:12.992722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:13.018713 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:40:13.042949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-127167212", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9839a451-68ef-402c-a445-af1f7dc2e79f"}], "security_groups": [{"name": "tempest-securitygroup--761144907"}], "key_name": "tempest-keypair-1310980637", "user_data": "}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:13.154802 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] validate_networks() for [('9839a451-68ef-402c-a445-af1f7dc2e79f', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:40:13.341115 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-34e9f834-13d6-4107-9380-a60d31cbce80 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 204 len: 0 microversion: 2.1 time: 0.362859 Oct 04 10:40:13.342115 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 318/627] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:40:12 2022] DELETE /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:40:13.353291 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:13.355321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:13.362431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:13.362909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:13.363342 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:13.364162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:13.364679 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:13.365329 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:13.524658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:13.539039 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e00f0833-820f-4596-af93-446de89d81ca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1513 microversion: 2.1 time: 0.192241 Oct 04 10:40:13.540059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 319/628] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:13 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:13.562779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:40:13.563433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:40:13.565360 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:40:13.565360 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:40:13.565360 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:40:13.574458 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:13.574937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:13.575364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:13.576078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:13.576526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:13.577017 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:13.590351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:13.597742 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:40:13.602195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Getting quotas for user 3008efcf02c644e3bc09850d6bd6eb63 and project 7857413ab9f24988bde94f9bf52b76a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:40:13.615438 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:40:13.618911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:40:13.733102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-491dad99-5157-4dbe-b207-b727c2d8277e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.695498 Oct 04 10:40:13.733674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 310/629] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:40:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 10:40:13.744915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ab5eead6-72f8-4179-a7d7-5903bb998fc7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:13.747574 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ab5eead6-72f8-4179-a7d7-5903bb998fc7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:13.836738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ab5eead6-72f8-4179-a7d7-5903bb998fc7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:13.844282 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ab5eead6-72f8-4179-a7d7-5903bb998fc7 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1237 microversion: 2.1 time: 0.103188 Oct 04 10:40:13.849369 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 320/630] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:13 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:14.014234 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:14.014786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:14.021874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.022362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.022792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.023486 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.024009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.024378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.026572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1703419357", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1"}], "security_groups": [{"name": "tempest-securitygroup--865188003"}], "key_name": "tempest-keypair-1245436048", "user_data": "}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:14.057629 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:40:14.141274 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] validate_networks() for [('2d2dda4d-0e81-4b7b-91dc-2385c85f9bc1', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:40:14.363764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4f8e5192-af5c-4b16-b4d6-08deb1abce87 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 204 len: 0 microversion: 2.1 time: 0.354233 Oct 04 10:40:14.365153 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 311/631] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:40:14 2022] DELETE /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:40:14.373516 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:14.374210 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:14.380936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.381378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.381814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.382506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.382949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.383371 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.523441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:14.526007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:40:14.526436 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:40:14.527157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:40:14.527603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:40:14.528041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:40:14.531682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ff27b367-8fe8-49ee-bb3c-2ff5ae2ed68a tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1508 microversion: 2.1 time: 0.162161 Oct 04 10:40:14.532344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 312/632] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:14 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:14.537543 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.538056 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.538527 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.539476 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.540189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.540723 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.558874 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:40:14.562933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Getting quotas for user 961ed374bc664b299c1a6425dc803dfa and project 29ede48c03e04fd6a00a874c318f5c3c. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:40:14.563601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:14.564213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:14.570657 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.571343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.571862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.572553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.573029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.573450 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.574209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:40:14.576513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:40:14.703061 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:14.711027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-42cac747-23aa-40be-8d48-5947fa4d6e28 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1513 microversion: 2.1 time: 0.151314 Oct 04 10:40:14.711581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 313/633] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:14 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:14.749539 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7b1616cd-59d8-47e2-a579-6f257c08337f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728854 Oct 04 10:40:14.750218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 321/634] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:40:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 10:40:14.762369 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1061cf04-51d1-4bf9-9626-4805f26758c9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:14.762908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1061cf04-51d1-4bf9-9626-4805f26758c9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:14.818651 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1061cf04-51d1-4bf9-9626-4805f26758c9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:14.825607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1061cf04-51d1-4bf9-9626-4805f26758c9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1242 microversion: 2.1 time: 0.067443 Oct 04 10:40:14.826178 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 314/635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:14 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:14.872277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:14.872969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:14.881254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.882284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.882511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.883385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:14.883846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:14.884275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:14.960615 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:14.968884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5b536b8e-32e4-4c9d-b81b-f25821c3f655 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1241 microversion: 2.1 time: 0.100670 Oct 04 10:40:14.969444 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 322/636] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:14 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:15.555029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:15.555671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:15.565343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:15.565856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:15.566277 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:15.567080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:15.568223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:15.568702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:15.703119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:15.712064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f83312e8-1e64-4701-8d02-a0e35e16970e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1508 microversion: 2.1 time: 0.161047 Oct 04 10:40:15.712699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 315/637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:15 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:15.734069 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:15.734829 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:15.741846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:15.742292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:15.742724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:15.743405 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:15.743852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:15.744273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:15.850978 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:15.851509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:15.857568 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:15.858060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:15.858493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:15.859183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:15.859634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:15.860059 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:15.873700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:15.882623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d837576c-8d61-404c-9755-b551a2c9e55b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1513 microversion: 2.1 time: 0.152320 Oct 04 10:40:15.883204 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 323/638] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:15 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:15.921513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:15.929869 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f10d78cd-c366-4e6c-9753-bb78df637b63 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1246 microversion: 2.1 time: 0.083026 Oct 04 10:40:15.930429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 316/639] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:15 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:15.994462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:15.995063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:16.001332 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:16.001865 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:16.002341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:16.003542 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:16.004085 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:16.005656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:16.064795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:16.073023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bcbca88f-dfc0-439f-afe4-74509aae9095 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1241 microversion: 2.1 time: 0.082290 Oct 04 10:40:16.073582 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 324/640] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:15 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:16.734386 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:16.735010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:16.741534 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:16.742022 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:16.742462 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:16.743151 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:16.743605 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:16.744030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:16.873451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:16.881847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-506d3741-9bd5-4375-90ac-695b973260e4 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1508 microversion: 2.1 time: 0.151369 Oct 04 10:40:16.882405 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 317/641] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:16 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:16.905262 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:16.905892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:16.912296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:16.912768 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:16.913244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:16.913924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:16.914370 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:16.914788 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:17.010915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:17.011527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:17.017367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:17.017842 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:17.018276 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:17.018960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:17.019407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:17.019824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:17.046008 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:17.053972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-133ac9a7-5519-418c-867d-3a3eedf076a0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1513 microversion: 2.1 time: 0.152463 Oct 04 10:40:17.054548 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 325/642] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:16 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:17.082690 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:17.092445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e53ad461-9d06-4be4-b937-7c2a03b0e9be tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1246 microversion: 2.1 time: 0.143190 Oct 04 10:40:17.093130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 318/643] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:16 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1246 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:17.095457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:17.096073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:17.102150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:17.102706 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:17.103212 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:17.104029 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:17.104545 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:17.105073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:17.166003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:17.174321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-704834f0-177d-41c7-b891-526392cf222a tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1241 microversion: 2.1 time: 0.082565 Oct 04 10:40:17.174816 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 326/644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:17 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:17.906116 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:17.906742 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:17.914423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:17.914919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:17.915359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:17.916073 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:17.916536 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:17.916989 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.078422 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:18.079044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:18.087124 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.087903 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.088532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.089474 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.090091 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.090675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.108624 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:18.249221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:18.260187 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-12817521-3090-4b92-8394-223221c64f3d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1508 microversion: 2.1 time: 0.357884 Oct 04 10:40:18.260752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 319/645] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:17 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:18.278691 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:18.279418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:18.285666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.286269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.286715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.287423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.288058 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.288663 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.320385 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:18.330026 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6e50b6e8-437c-44a8-af69-887339e7e8ae tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1513 microversion: 2.1 time: 0.255292 Oct 04 10:40:18.349390 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 327/646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:18 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:18.354830 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:18.355549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:18.362114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.362878 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.366125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.366125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.366125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.366125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.388064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:18.396540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b680493d-5b36-4203-a17d-9ce7b57d93ea tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1238 microversion: 2.1 time: 0.134374 Oct 04 10:40:18.409100 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 320/647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:18 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1238 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:18.444434 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:18.453439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5e9d8fe7-5e7b-496f-8a17-4e2aa0b6d025 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1289 microversion: 2.1 time: 0.102986 Oct 04 10:40:18.454008 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 328/648] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:18 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:18.625755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-31b63f03-9b57-4c47-979b-4477e80f63c6 req-67b27205-608c-4c57-93df-214ad1be44ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3be87b4-5b52-4be1-861b-44bafa867831", "name": "network-vif-deleted", "tag": "9633d963-f8b9-4279-94fb-546950be618d"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:18.630738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-c2bfc492-2330-45d2-80a8-e799c10b14d5 req-5d396c4c-7c0b-4b30-870f-5b86079343c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11490232-8b15-4d8e-a17b-37d396ed45c8", "name": "network-vif-deleted", "tag": "400684a3-ba04-4e27-a0d8-fe9481b753fe"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:18.637187 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-31b63f03-9b57-4c47-979b-4477e80f63c6 req-67b27205-608c-4c57-93df-214ad1be44ff service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.637658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-31b63f03-9b57-4c47-979b-4477e80f63c6 req-67b27205-608c-4c57-93df-214ad1be44ff service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.638273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-31b63f03-9b57-4c47-979b-4477e80f63c6 req-67b27205-608c-4c57-93df-214ad1be44ff service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.652599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c2bfc492-2330-45d2-80a8-e799c10b14d5 req-5d396c4c-7c0b-4b30-870f-5b86079343c3 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:18.653143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c2bfc492-2330-45d2-80a8-e799c10b14d5 req-5d396c4c-7c0b-4b30-870f-5b86079343c3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:18.653331 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-31b63f03-9b57-4c47-979b-4477e80f63c6 req-67b27205-608c-4c57-93df-214ad1be44ff service nova] Creating event network-vif-deleted:9633d963-f8b9-4279-94fb-546950be618d for instance e3be87b4-5b52-4be1-861b-44bafa867831 on hv-cinder-85919 Oct 04 10:40:18.653905 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c2bfc492-2330-45d2-80a8-e799c10b14d5 req-5d396c4c-7c0b-4b30-870f-5b86079343c3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:18.659199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-31b63f03-9b57-4c47-979b-4477e80f63c6 req-67b27205-608c-4c57-93df-214ad1be44ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050036 Oct 04 10:40:18.665127 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 321/649] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:18.668305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-c2bfc492-2330-45d2-80a8-e799c10b14d5 req-5d396c4c-7c0b-4b30-870f-5b86079343c3 service nova] Creating event network-vif-deleted:400684a3-ba04-4e27-a0d8-fe9481b753fe for instance 11490232-8b15-4d8e-a17b-37d396ed45c8 on hv-cinder-85919 Oct 04 10:40:18.673504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-c2bfc492-2330-45d2-80a8-e799c10b14d5 req-5d396c4c-7c0b-4b30-870f-5b86079343c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047992 Oct 04 10:40:18.676919 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 329/650] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:19.287693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:19.288395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:19.294562 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.295047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.295487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.296180 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.296634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.297123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.330914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.331440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.331874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.332379 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid 11490232-8b15-4d8e-a17b-37d396ed45c8 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:19.359997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:19.360852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:19.368777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.369535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.369977 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.370700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.371170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.371583 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.376761 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:19.384677 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ceb12c00-43ee-419c-a304-b5f5db5cc8d0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1311 microversion: 2.1 time: 0.102531 Oct 04 10:40:19.385300 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 322/651] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:19 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:19.406279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.406756 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.407199 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.407636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lazy-loading 'fault' on Instance uuid e3be87b4-5b52-4be1-861b-44bafa867831 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:19.422241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:19.422856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:19.430459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.433177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.433177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.433177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.433177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.433686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.463293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:19.472263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3aa65918-f842-4892-ad43-c0da0d8d2261 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1308 microversion: 2.1 time: 0.117096 Oct 04 10:40:19.487650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 330/652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:19 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:19.505609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:19.517722 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5741d8d0-c9a4-4f05-b993-79a2693270f8 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1238 microversion: 2.1 time: 0.100309 Oct 04 10:40:19.518317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 323/653] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:19 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:19.575884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:19.576912 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:19.591260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.592729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.593456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.594258 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:19.595106 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:19.595724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:19.683930 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:19.691567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-090dc474-2c01-47ec-8d50-2607d3b16d50 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1295 microversion: 2.1 time: 0.216618 Oct 04 10:40:19.692190 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 331/654] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:19 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1295 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:20.407681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:20.408847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:20.420128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.420619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.421093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.421805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.422262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.422689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.481401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.481784 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.482221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.482672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid 11490232-8b15-4d8e-a17b-37d396ed45c8 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:20.500880 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:20.502313 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:20.509907 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.511554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.512151 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.512878 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.513347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.513777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.526337 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:20.529050 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:20.535726 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-343d34d2-f308-441c-8878-4fca18e24904 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1311 microversion: 2.1 time: 0.131865 Oct 04 10:40:20.536641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 324/655] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:20 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:20.541917 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:20.542648 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:20.548660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.549287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.549776 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.550547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.551013 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.551441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.564389 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.564897 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.565344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.565793 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lazy-loading 'fault' on Instance uuid e3be87b4-5b52-4be1-861b-44bafa867831 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:20.659893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:20.659893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e8635fff-ed14-4c60-aa29-038be0f37b6a tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1308 microversion: 2.1 time: 0.162276 Oct 04 10:40:20.669765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 332/656] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:20 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:20.718433 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:20.719497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:20.726948 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.727710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.728330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.729395 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:20.729999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:20.731023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:20.826970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:20.841507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-623bd706-bd73-4021-9c70-eb2aa962734e tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1302 microversion: 2.1 time: 0.303150 Oct 04 10:40:20.847486 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 325/657] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:20 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1302 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:20.944186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:20.953490 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-33b14c3e-dec5-4d76-9444-4a4ed6dd16bf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.239755 Oct 04 10:40:20.954065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 333/658] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:20 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:21.479093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-53e898b7-17e2-48af-9856-592a1385b538 req-63db4e53-5e07-4dd1-807e-4ab72290fe53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ea49f8-7a4d-4d16-937f-6da620fa9eb5", "tag": "d28e774a-f971-4d5a-bcca-1c3ec025055b"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:21.490556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-53e898b7-17e2-48af-9856-592a1385b538 req-63db4e53-5e07-4dd1-807e-4ab72290fe53 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.491555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-53e898b7-17e2-48af-9856-592a1385b538 req-63db4e53-5e07-4dd1-807e-4ab72290fe53 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.492172 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-53e898b7-17e2-48af-9856-592a1385b538 req-63db4e53-5e07-4dd1-807e-4ab72290fe53 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.505498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-53e898b7-17e2-48af-9856-592a1385b538 req-63db4e53-5e07-4dd1-807e-4ab72290fe53 service nova] Creating event network-changed:d28e774a-f971-4d5a-bcca-1c3ec025055b for instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 on hv-cinder-85919 Oct 04 10:40:21.510865 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-53e898b7-17e2-48af-9856-592a1385b538 req-63db4e53-5e07-4dd1-807e-4ab72290fe53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037574 Oct 04 10:40:21.511479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 326/659] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:21.563630 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:21.565231 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:21.574341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.575111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.575747 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.577142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.577672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.578162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.636025 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.640285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.640285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.640285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid 11490232-8b15-4d8e-a17b-37d396ed45c8 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:21.683414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:21.684996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:21.693152 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.694302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.694761 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.695663 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.696128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.696586 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.704608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:21.713824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8ad31be5-d757-4b7c-8150-b7b0a327a8a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 200 len: 1311 microversion: 2.1 time: 0.154404 Oct 04 10:40:21.714412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 334/660] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:21 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:21.755599 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.758130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.758130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.758130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lazy-loading 'fault' on Instance uuid e3be87b4-5b52-4be1-861b-44bafa867831 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:21.805799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:21.813357 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-05d09494-1a51-4795-95b6-cce2272f66c6 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 200 len: 1308 microversion: 2.1 time: 0.135353 Oct 04 10:40:21.813926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 327/661] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:21 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 1308 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:21.867475 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:21.868046 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:21.873968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.874447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.874884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.875591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.876024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.876445 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.978348 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:21.978967 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:21.990657 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.991649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.992437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:21.993984 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:21.994526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:21.994870 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:22.171189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:22.171189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b43c22d8-62f6-486d-bcca-776b9781774a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.269513 Oct 04 10:40:22.171189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 335/662] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:21 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:22.172067 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:22.176364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e122cc5f-e8af-499b-9c01-9e0afe524767 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.201768 Oct 04 10:40:22.177829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 328/663] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:21 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:22.739542 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:22.742119 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: 11490232-8b15-4d8e-a17b-37d396ed45c8] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:22.749035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:22.750143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:22.750597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:22.751400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:22.751885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:22.752317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:22.767134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] HTTP exception thrown: Instance 11490232-8b15-4d8e-a17b-37d396ed45c8 could not be found. Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Request method failure captured: Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 HTTP/1.1 Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxrmNYd0EZ-22UGk_kKNY6-0U_YRbMfiBo-fxh7FZTtqb9rUroRPcVLUU-SbHpoTBcklmVbnvHkoYEQdtmLGXc7YkGQnXycCpMq6KhWtCeEcQxXaTCbjv5IgzPz4dGOSeijd4m0FZuRhHTH7qqPMbzi5nZUEFx_XbtAY9B33MXP2Vc Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:40:22.768789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e94e5705bcfd476e87b2fa0af6ff597a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: c4f4844eb5e14d789476cfb44e2516f0 Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 11490232-8b15-4d8e-a17b-37d396ed45c8 could not be found. Oct 04 10:40:22.771149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '11490232-8b15-4d8e-a17b-37d396ed45c8'} Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11490232-8b15-4d8e-a17b-37d396ed45c8 could not be found. Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:22.775854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11490232-8b15-4d8e-a17b-37d396ed45c8 could not be found. Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11490232-8b15-4d8e-a17b-37d396ed45c8 could not be found. Oct 04 10:40:22.777473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.779424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Returning 404 to user: Instance 11490232-8b15-4d8e-a17b-37d396ed45c8 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:22.779424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bf995a88-9243-4de5-b171-9800c3a8e210 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8" status: 404 len: 111 microversion: 2.1 time: 0.036009 Oct 04 10:40:22.779424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 336/664] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:22 2022] GET /compute/v2.1/servers/11490232-8b15-4d8e-a17b-37d396ed45c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:40:22.784354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:22.791218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:22.791867 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:22.792365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:22.792796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:22.793527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:22.794165 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:22.794591 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:22.821810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:40:22.837622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:22.838378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: e3be87b4-5b52-4be1-861b-44bafa867831] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:22.844293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:22.844777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:22.845457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:22.846157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:22.846611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:22.847210 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:22.861479 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] HTTP exception thrown: Instance e3be87b4-5b52-4be1-861b-44bafa867831 could not be found. Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Request method failure captured: Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 HTTP/1.1 Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA1I_fcr1Qy-BNyzVoO9RjdKCosPdKPMd7ljh5gKQFt7dFBD-76BZijNJ_Vlxsr8N4jaM7EgkY-aHiqQEcM95_PagBZ22qbpLH7zeaLG_Mhx7rm8ZsKSPgq0HDOSL14dNro-b0z78kBnzXZJZkyL4rvFVUnhhLjUmGeIhs8GPC9q_gI Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 7d344597211d4f6b9a3c7961e7b0f706 Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesSnapshotTestJSON-105377300 Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:40:22.864266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d344597211d4f6b9a3c7961e7b0f706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d344597211d4f6b9a3c7961e7b0f706", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d344597211d4f6b9a3c7961e7b0f706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d344597211d4f6b9a3c7961e7b0f706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesSnapshotTestJSON-105377300 Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 7d344597211d4f6b9a3c7961e7b0f706 Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-105377300 Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesSnapshotTestJSON-105377300-project Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: f8d11882baae44968b8d451d6a30af87 Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesSnapshotTestJSON-105377300-project Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance e3be87b4-5b52-4be1-861b-44bafa867831 could not be found. Oct 04 10:40:22.866485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'e3be87b4-5b52-4be1-861b-44bafa867831'} Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3be87b4-5b52-4be1-861b-44bafa867831 could not be found. Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:22.867777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3be87b4-5b52-4be1-861b-44bafa867831 could not be found. Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3be87b4-5b52-4be1-861b-44bafa867831 could not be found. Oct 04 10:40:22.870103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:22.872223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Returning 404 to user: Instance e3be87b4-5b52-4be1-861b-44bafa867831 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:22.872223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-725de48c-52b0-4dff-80a0-51f9a5d56e81 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831" status: 404 len: 111 microversion: 2.1 time: 0.033684 Oct 04 10:40:22.872223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 337/665] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:22 2022] GET /compute/v2.1/servers/e3be87b4-5b52-4be1-861b-44bafa867831 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:40:23.118245 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:23.118738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:23.124746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.125260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.125881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.126682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.127133 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.127553 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.153295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6bb23e78-bde1-4acd-9066-c63355ac138e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/ips" status: 200 len: 150 microversion: 2.20 time: 0.039212 Oct 04 10:40:23.160833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 338/666] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Oct 4 10:40:23 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:40:23.165712 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:23.166322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:23.172159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.172945 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.173381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.174310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.174761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.175187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.215231 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-23949c03-e7ae-4f06-a4aa-9faf8cc93358 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 204 len: 0 microversion: 2.1 time: 0.435019 Oct 04 10:40:23.219321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 329/667] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:40:22 2022] DELETE /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:40:23.223899 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:23.224741 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:23.245979 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.257431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.257913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.258819 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.260586 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.260983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.392739 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:23.401271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8d0a4dac-70e9-441a-8ef2-d881897337a3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.239267 Oct 04 10:40:23.401846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 339/668] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:23 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:23.406271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:23.406881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:23.412772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.413306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.423240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.423240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.423240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.423240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.459859 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:23.464634 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ebfb44cc-a190-4db8-9fd2-c8311a3fa7a4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.246991 Oct 04 10:40:23.465233 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 330/669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:23 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:23.550933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:23.560321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fa8c3f41-99c7-4a89-8813-47c68ce7f13f tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.157424 Oct 04 10:40:23.560915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 340/670] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:23 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:23.570530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-ae4fa6ed-141f-4a18-ad0a-dac36039bef9 req-6e9d7b29-87f5-408a-a780-c9934b68878a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211c2430-47ea-434e-bb6f-3acdc52e10cf", "tag": "6ba4270e-5e41-4049-9d52-e28b3b0d2424"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:23.580077 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ae4fa6ed-141f-4a18-ad0a-dac36039bef9 req-6e9d7b29-87f5-408a-a780-c9934b68878a service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:23.580556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ae4fa6ed-141f-4a18-ad0a-dac36039bef9 req-6e9d7b29-87f5-408a-a780-c9934b68878a service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:23.581012 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ae4fa6ed-141f-4a18-ad0a-dac36039bef9 req-6e9d7b29-87f5-408a-a780-c9934b68878a service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:23.591251 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:23.593632 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-ae4fa6ed-141f-4a18-ad0a-dac36039bef9 req-6e9d7b29-87f5-408a-a780-c9934b68878a service nova] Creating event network-changed:6ba4270e-5e41-4049-9d52-e28b3b0d2424 for instance 211c2430-47ea-434e-bb6f-3acdc52e10cf on hv-cinder-85919 Oct 04 10:40:23.599114 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-ae4fa6ed-141f-4a18-ad0a-dac36039bef9 req-6e9d7b29-87f5-408a-a780-c9934b68878a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032278 Oct 04 10:40:23.600100 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 331/671] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:24.425586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:24.425586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:24.432812 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:24.433322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:24.433757 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:24.434588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:24.434993 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:24.435499 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:24.490208 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:24.490906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:24.497711 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:24.498339 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:24.498732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:24.499431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:24.499883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:24.500295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:24.549185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:24.569363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=16 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:24.573716 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:24.581571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-28a4018c-72f7-4b53-97d0-1a82f546d0c6 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.160354 Oct 04 10:40:24.582062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 341/672] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:24 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:24.647933 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:24.649339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:24.649956 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:24.656041 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a83b1622-4737-4e53-a138-cbfa810c145d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.172131 Oct 04 10:40:24.656199 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:24.656563 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:24.656721 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 332/673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:24 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:24.657030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:24.657716 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:24.658170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:24.658720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:24.804337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:24.812051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-dca0871f-7d76-4bad-b457-b0173171e930 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.223716 Oct 04 10:40:24.812619 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 342/674] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:24 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:25.603692 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:25.604226 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:25.606686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=8 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:25.612214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:25.612693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:25.613149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:25.614390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:25.615474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:25.615904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:25.680621 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:25.681614 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:25.687927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:25.688415 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:25.688875 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:25.689646 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:25.690098 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:25.690529 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:25.749829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:25.758417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7f747b39-3c77-4424-adc1-35fa726dc91a tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.158537 Oct 04 10:40:25.759151 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 333/675] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:25 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:25.823467 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:25.831362 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-66444e1f-3507-4418-b5fd-ac92d9874381 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.155160 Oct 04 10:40:25.832238 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 343/676] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:25 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:25.836800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:25.837512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:25.843681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:25.844243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:25.844754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:25.845553 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:25.846078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:25.846627 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:25.981374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:25.989813 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4f057133-8fb7-4f2f-8b51-67ec3ccfca9e tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.156514 Oct 04 10:40:25.990391 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 334/677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:25 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:26.781572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:26.782499 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:26.789096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:26.792134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:26.792134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:26.792134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:26.792134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:26.792524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:26.855565 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:26.856176 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:26.864477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:26.865298 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:26.865746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:26.866467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:26.866927 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:26.867355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:26.935005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:26.944545 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-53b92561-a6c0-488d-acc8-039716b55c91 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.166668 Oct 04 10:40:26.945218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 344/678] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:26 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:27.014060 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:27.014762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:27.021366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:27.021952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:27.022461 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:27.023288 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:27.023805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:27.024314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:27.041781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:27.047522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:27.056269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-61198044-ce2f-4d32-b884-78875b1e9654 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.204916 Oct 04 10:40:27.057150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 335/679] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:26 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:27.174628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:27.188374 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a8b56bfc-4177-4ad7-8c89-5be7571455e6 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1522 microversion: 2.1 time: 0.178871 Oct 04 10:40:27.189154 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 345/680] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:27 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:27.762619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:27.763161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:27.769562 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:27.770479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:27.774132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:27.774132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:27.774132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:27.774132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:27.795526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lazy-loading 'flavor' on Instance uuid fefaea3d-478b-4401-a34c-74c864644738 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:27.925750 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-d3aca0ea-3933-4337-83dd-41ef276dc4d9 req-b2e367b8-89e9-4338-beaa-d91bb18b98cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5127c3-d06a-4548-958d-be221a9ce7f5", "name": "network-vif-deleted", "tag": "ae6be7a2-79d8-4368-9eea-71bea4e593ad"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:27.936561 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-d3aca0ea-3933-4337-83dd-41ef276dc4d9 req-b2e367b8-89e9-4338-beaa-d91bb18b98cc service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:27.937078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-d3aca0ea-3933-4337-83dd-41ef276dc4d9 req-b2e367b8-89e9-4338-beaa-d91bb18b98cc service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:27.937504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-d3aca0ea-3933-4337-83dd-41ef276dc4d9 req-b2e367b8-89e9-4338-beaa-d91bb18b98cc service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:27.949821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-d3aca0ea-3933-4337-83dd-41ef276dc4d9 req-b2e367b8-89e9-4338-beaa-d91bb18b98cc service nova] Creating event network-vif-deleted:ae6be7a2-79d8-4368-9eea-71bea4e593ad for instance ed5127c3-d06a-4548-958d-be221a9ce7f5 on hv-cinder-85919 Oct 04 10:40:27.955063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-d3aca0ea-3933-4337-83dd-41ef276dc4d9 req-b2e367b8-89e9-4338-beaa-d91bb18b98cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 Oct 04 10:40:27.955743 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 346/681] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:27.976063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:27.978431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:27.982850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:27.983337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:27.983781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:27.984521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:27.985043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:27.985453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.127840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:28.136213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-261a27ed-ae29-4c54-80df-d28b7d45f892 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.164255 Oct 04 10:40:28.136772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 347/682] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:27 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:28.141482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:28.142017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:28.151276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:28.151765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:28.152200 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.156250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:28.156250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:28.156250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.311532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:28.324406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7db8a34f-d3de-4c45-911e-258005c087b2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.186561 Oct 04 10:40:28.325099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 348/683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:28 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:28.329608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:28.330213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:28.332074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:28.337159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:28.337962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:28.338408 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.339275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:28.339898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:28.340350 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.390690 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c6fd04cb-7677-4991-a9d4-c9d7150a0413 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/action" status: 202 len: 0 microversion: 2.20 time: 0.632002 Oct 04 10:40:28.391604 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 336/684] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 10:40:27 2022] POST /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 10:40:28.402519 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:28.405353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:28.413717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:28.414205 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:28.414641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.415350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:28.415800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:28.417975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:28.423700 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.425697 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3542fc40-074b-4230-b35a-47c7aeaa1b13 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1480 microversion: 2.1 time: 0.099658 Oct 04 10:40:28.426428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 349/685] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:28 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1480 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:28.564839 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:28.578307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:28.579767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:28.581000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6e316a38-a8e4-471b-a764-0a324d9607bf tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.184494 Oct 04 10:40:28.581562 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 337/686] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:28 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:40:28.691520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-2db281fe-7392-4aa8-adca-57eb33c4ee48 req-5cee5497-3958-470b-a63e-ae4f8c145af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ea49f8-7a4d-4d16-937f-6da620fa9eb5", "name": "network-vif-plugged", "status": "completed", "tag": "d28e774a-f971-4d5a-bcca-1c3ec025055b"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:28.704682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-2db281fe-7392-4aa8-adca-57eb33c4ee48 req-5cee5497-3958-470b-a63e-ae4f8c145af3 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:28.704682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-2db281fe-7392-4aa8-adca-57eb33c4ee48 req-5cee5497-3958-470b-a63e-ae4f8c145af3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:28.705293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-2db281fe-7392-4aa8-adca-57eb33c4ee48 req-5cee5497-3958-470b-a63e-ae4f8c145af3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:28.717469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-2db281fe-7392-4aa8-adca-57eb33c4ee48 req-5cee5497-3958-470b-a63e-ae4f8c145af3 service nova] Creating event network-vif-plugged:d28e774a-f971-4d5a-bcca-1c3ec025055b for instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 on hv-cinder-85919 Oct 04 10:40:28.722215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-2db281fe-7392-4aa8-adca-57eb33c4ee48 req-5cee5497-3958-470b-a63e-ae4f8c145af3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Oct 04 10:40:28.722786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 350/687] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:29.159650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:29.160266 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:29.166433 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.175444 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.175444 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.175444 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.175444 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.176609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.310991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:29.310991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:29.315893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f413e2df-fba1-4fe3-bf5b-61c928446f37 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.160216 Oct 04 10:40:29.316729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 338/688] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:29 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:29.350704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:29.351438 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:29.358483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.358967 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.359403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.360113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.360602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.361004 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.449334 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:29.449989 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:29.457182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.458276 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.458806 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.459521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.462298 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.462298 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.491981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.492468 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.492970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.493399 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid ed5127c3-d06a-4548-958d-be221a9ce7f5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:29.501075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:29.508885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-307a4bf8-1bb2-46c6-8845-6fb462c10edc tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.163418 Oct 04 10:40:29.509478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 351/689] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:29 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:29.534800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:29.542761 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5f85e290-44f5-4d27-a61d-e1ce1feb9cee tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1312 microversion: 2.1 time: 0.097304 Oct 04 10:40:29.543338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 339/690] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:29 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:29.608051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:29.608659 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:29.615295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.615707 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.616145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.616843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:29.617316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:29.617741 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:29.744888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:29.752942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:29.755466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:29.756636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-34de3618-13aa-4aa7-a65a-89b51b87ae70 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.152504 Oct 04 10:40:29.757229 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 352/691] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:29 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:30.339921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:30.340490 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:30.347777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.348501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.349087 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.350245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.350715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.351149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.480163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:30.487692 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9f396db2-b5e8-47b9-b814-147a3686441f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.152355 Oct 04 10:40:30.488258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 340/692] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:30 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:30.531384 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:30.531991 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:30.539224 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.539698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.540130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.540820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.541302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.541722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.565005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:30.565610 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:30.571399 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.571871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.572311 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.573033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.573484 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.573903 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.605645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.606014 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.606447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.606892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid ed5127c3-d06a-4548-958d-be221a9ce7f5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:30.649820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:30.657325 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1e9a2430-69fd-472f-8910-6d10de6b7bde tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1312 microversion: 2.1 time: 0.096114 Oct 04 10:40:30.658072 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 341/693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:30 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:30.677827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:30.685344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-28273960-00b3-4904-ac72-f0d03eb55626 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.157756 Oct 04 10:40:30.685914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 353/694] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:30 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:30.788936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:30.789543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:30.795372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.795847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.796278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.796983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:30.797432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:30.797850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:30.927642 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:30.935508 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:30.936952 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:30.938088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7fef1336-f7f9-4151-b27e-b6cc3f2dfd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.153774 Oct 04 10:40:30.938636 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 342/695] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:30 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:31.511984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:31.512615 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:31.518652 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.519127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.519558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.520246 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.520687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.521142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.652973 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:31.661464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4243c05d-54c1-44b2-9470-ba8d0a2b4b04 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.152862 Oct 04 10:40:31.662030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 354/696] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:31 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:31.680241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:31.680960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:31.683244 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:31.687880 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.688361 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.688799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.689517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.689969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.690392 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.710000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:31.710927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:31.716789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.717322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.717761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.718451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.718906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.719328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.721655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.722138 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.722573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.723019 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid ed5127c3-d06a-4548-958d-be221a9ce7f5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:31.765009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:31.773577 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-716c54a2-5171-4a6a-af0d-cff043095652 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1312 microversion: 2.1 time: 0.097722 Oct 04 10:40:31.774140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 343/697] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:31 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:31.851146 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:31.858685 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-98f52a04-45b5-4d10-979c-297545cb7bf2 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.154163 Oct 04 10:40:31.859249 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 355/698] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:31 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:31.963693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:31.964297 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:31.970652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.971129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.971572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:31.972240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:31.972686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:31.973743 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.108048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:32.116782 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:32.118232 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:32.119374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ad564cc9-f6d0-44b8-94cd-47c0f942fd47 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.159784 Oct 04 10:40:32.119923 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 344/699] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:31 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:32.481534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-470995391", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "networks": [{"uuid": "469606a8-b8ac-434f-83d0-93dfd880057a"}]}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:32.538710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] validate_networks() for [('469606a8-b8ac-434f-83d0-93dfd880057a', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:40:32.684814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:32.685451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:32.692769 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.693622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.693775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.694456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.694907 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.695511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.839498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:32.847660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d9d434e5-4820-4f12-bb86-9319a5b55bb9 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.166907 Oct 04 10:40:32.848759 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 345/700] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:32 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:32.853595 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:32.854192 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:32.860049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.860740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.861496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.862195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.862652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.863077 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.896829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.897340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.897821 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.898261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lazy-loading 'fault' on Instance uuid ed5127c3-d06a-4548-958d-be221a9ce7f5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:40:32.939813 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f4844eb5e14d789476cfb44e2516f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94e5705bcfd476e87b2fa0af6ff597a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:32.947137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f10baaac-e30d-431b-9954-d736f1546e1d tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 200 len: 1312 microversion: 2.1 time: 0.097305 Oct 04 10:40:32.947707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 346/701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:32 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:32.959673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:32.961253 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:32.967012 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.967503 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.967940 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.968636 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.969125 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.969579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.975403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:40:32.975922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:40:32.976276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:40:32.976682 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:40:32.977113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:40:32.985791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.989831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.989831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:32.989831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:32.989831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:32.990207 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:33.005672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Getting quotas for project 7d344597211d4f6b9a3c7961e7b0f706. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:40:33.009704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Getting quotas for user f8d11882baae44968b8d451d6a30af87 and project 7d344597211d4f6b9a3c7961e7b0f706. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:40:33.021868 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:40:33.024158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:40:33.105890 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:33.113794 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ca74b18a-a56f-4a9d-b2fd-2ddc589ae225 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1362 microversion: 2.1 time: 0.164829 Oct 04 10:40:33.114446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 347/702] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:32 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:33.145398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:33.145997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:33.151906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:33.152388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:33.152818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:33.153529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:33.153977 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:33.154421 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:33.165736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cefb7658-a5a5-4bb0-bf41-51fa46277bd1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688016 Oct 04 10:40:33.166384 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 356/703] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:40:33.177602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e31a733b-3722-47c2-91e4-d034e384bf65 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:33.183187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e31a733b-3722-47c2-91e4-d034e384bf65 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:33.241232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e31a733b-3722-47c2-91e4-d034e384bf65 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:33.251137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e31a733b-3722-47c2-91e4-d034e384bf65 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1218 microversion: 2.1 time: 0.077421 Oct 04 10:40:33.252417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 357/704] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:33 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:33.318495 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:33.327972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:33.329528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:33.330768 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-10b5ff18-b2f5-4f17-88b2-17b6dd82c267 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.189763 Oct 04 10:40:33.331418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 348/705] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:33 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:40:33.871218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:33.871989 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:33.878404 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:33.878892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:33.880556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:33.881294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:33.881752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:33.882214 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:33.970548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:33.971160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] [instance: ed5127c3-d06a-4548-958d-be221a9ce7f5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:33.978038 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:33.978532 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:33.978998 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:33.979695 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:33.980148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:33.980566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:33.995095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] HTTP exception thrown: Instance ed5127c3-d06a-4548-958d-be221a9ce7f5 could not be found. Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Request method failure captured: Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 HTTP/1.1 Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxrmNYd0EZ-22UGk_kKNY6-0U_YRbMfiBo-fxh7FZTtqb9rUroRPcVLUU-SbHpoTBcklmVbnvHkoYEQdtmLGXc7YkGQnXycCpMq6KhWtCeEcQxXaTCbjv5IgzPz4dGOSeijd4m0FZuRhHTH7qqPMbzi5nZUEFx_XbtAY9B33MXP2Vc Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:40:33.996751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e94e5705bcfd476e87b2fa0af6ff597a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e94e5705bcfd476e87b2fa0af6ff597a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: e94e5705bcfd476e87b2fa0af6ff597a Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1141692354 Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: c4f4844eb5e14d789476cfb44e2516f0 Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1141692354-project Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance ed5127c3-d06a-4548-958d-be221a9ce7f5 could not be found. Oct 04 10:40:34.005504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'ed5127c3-d06a-4548-958d-be221a9ce7f5'} Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5127c3-d06a-4548-958d-be221a9ce7f5 could not be found. Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:34.006910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5127c3-d06a-4548-958d-be221a9ce7f5 could not be found. Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5127c3-d06a-4548-958d-be221a9ce7f5 could not be found. Oct 04 10:40:34.008579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:34.009937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] Returning 404 to user: Instance ed5127c3-d06a-4548-958d-be221a9ce7f5 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:34.009937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-431391c7-5929-4eea-a576-cf624351d2a0 tempest-ServerRescueNegativeTestJSON-1141692354 tempest-ServerRescueNegativeTestJSON-1141692354-project] 10.222.0.42 "GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5" status: 404 len: 111 microversion: 2.1 time: 0.031765 Oct 04 10:40:34.009937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 349/706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:33 2022] GET /compute/v2.1/servers/ed5127c3-d06a-4548-958d-be221a9ce7f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:40:34.016165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:34.024401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0a3dc488-f6cf-4fc9-81d9-a4822ab38004 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.157146 Oct 04 10:40:34.024979 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 358/707] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:33 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:34.136315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:34.136983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:34.143479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.143969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.144406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.145179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.145633 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.146047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.280575 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:34.281550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:34.288274 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.288764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.289239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.289940 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.290395 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.290849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.354951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:34.362693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7b5a1d6d-25f5-4b15-af9e-f4ccbd468c49 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1222 microversion: 2.1 time: 0.085890 Oct 04 10:40:34.363267 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 359/708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:34 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:34.375155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:34.381785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:34.382660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:34.385465 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-650d7cff-0b72-4bea-a71a-e546e3617dcf tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1549 microversion: 2.1 time: 0.253555 Oct 04 10:40:34.386269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 350/709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:34 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:34.391037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.391037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.391037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.391037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.391459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.391459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.413482 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:34.414545 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:34.421856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.422383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.422919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.423667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.424174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.424598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.538280 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:34.546537 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:34.547959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:34.549531 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3cad9e50-8a60-4584-8489-d6e9df2f2c50 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.171640 Oct 04 10:40:34.550095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 360/710] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:34 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:34.577860 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f3177875-62b5-44b7-a446-37aa8885fd3b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168903 Oct 04 10:40:34.578499 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 351/711] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:40:34 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:34.813236 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-7c231e4f-cfbe-409d-8a9a-a6f6b8a7f3f2 req-b38c4365-b7f2-4d33-88da-a27d08de8116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211c2430-47ea-434e-bb6f-3acdc52e10cf", "name": "network-vif-plugged", "status": "completed", "tag": "6ba4270e-5e41-4049-9d52-e28b3b0d2424"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:34.824897 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-7c231e4f-cfbe-409d-8a9a-a6f6b8a7f3f2 req-b38c4365-b7f2-4d33-88da-a27d08de8116 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:34.825386 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-7c231e4f-cfbe-409d-8a9a-a6f6b8a7f3f2 req-b38c4365-b7f2-4d33-88da-a27d08de8116 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:34.825797 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-7c231e4f-cfbe-409d-8a9a-a6f6b8a7f3f2 req-b38c4365-b7f2-4d33-88da-a27d08de8116 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:34.838705 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-7c231e4f-cfbe-409d-8a9a-a6f6b8a7f3f2 req-b38c4365-b7f2-4d33-88da-a27d08de8116 service nova] Creating event network-vif-plugged:6ba4270e-5e41-4049-9d52-e28b3b0d2424 for instance 211c2430-47ea-434e-bb6f-3acdc52e10cf on hv-cinder-85919 Oct 04 10:40:34.846822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-7c231e4f-cfbe-409d-8a9a-a6f6b8a7f3f2 req-b38c4365-b7f2-4d33-88da-a27d08de8116 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041865 Oct 04 10:40:34.846822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 361/712] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:35.054315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:35.054315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:35.057600 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:35.058222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:35.058860 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:35.061912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:35.062980 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:35.063508 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:35.347911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:35.357406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d9dcd804-3942-443c-8aa5-586d82f643c3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.313316 Oct 04 10:40:35.371095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 352/713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:35 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:35.388010 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:35.389315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:35.396087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:35.396573 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:35.397215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:35.397909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:35.398355 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:35.398775 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:35.575941 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:35.576648 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:35.582857 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:35.583345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:35.583898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:35.584487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:35.584959 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:35.585649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:35.718894 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:35.744827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4b2dac64-a4ee-46a8-bd3b-71097b9093cf tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1270 microversion: 2.1 time: 0.360797 Oct 04 10:40:35.745553 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 362/714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:35 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1270 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:35.851577 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:35.863355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:35.867081 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:35.868555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4928babb-fb94-47a3-ba56-f55d7d0ec0f0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.296730 Oct 04 10:40:35.887406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 353/715] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:35 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:40:36.009244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-fc9440bf-ab5c-41ac-8aeb-3b115c7fc518 req-ea18fe06-ba87-4bae-ab97-42e20d062e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ea49f8-7a4d-4d16-937f-6da620fa9eb5", "tag": "d28e774a-f971-4d5a-bcca-1c3ec025055b"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:36.020197 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fc9440bf-ab5c-41ac-8aeb-3b115c7fc518 req-ea18fe06-ba87-4bae-ab97-42e20d062e6e service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:36.026482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fc9440bf-ab5c-41ac-8aeb-3b115c7fc518 req-ea18fe06-ba87-4bae-ab97-42e20d062e6e service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:36.026482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fc9440bf-ab5c-41ac-8aeb-3b115c7fc518 req-ea18fe06-ba87-4bae-ab97-42e20d062e6e service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:36.036061 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-fc9440bf-ab5c-41ac-8aeb-3b115c7fc518 req-ea18fe06-ba87-4bae-ab97-42e20d062e6e service nova] Creating event network-changed:d28e774a-f971-4d5a-bcca-1c3ec025055b for instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 on hv-cinder-85919 Oct 04 10:40:36.048069 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-fc9440bf-ab5c-41ac-8aeb-3b115c7fc518 req-ea18fe06-ba87-4bae-ab97-42e20d062e6e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042460 Oct 04 10:40:36.053305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 363/716] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:36.384781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:36.386265 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:36.404739 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:36.415740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:36.415740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:36.415740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:36.415740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:36.416327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:36.686618 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:36.695261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-595b93cc-1623-4d91-b326-29b59c7d6de3 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1367 microversion: 2.1 time: 0.317333 Oct 04 10:40:36.696072 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 354/717] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:36 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:36.771245 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:36.771941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:36.790401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:36.791918 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:36.791918 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:36.793013 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:36.793673 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:36.794304 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:36.885894 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:36.894447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-52f3bff8-8c79-4d5e-93bf-64971ec42aca tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1276 microversion: 2.1 time: 0.127704 Oct 04 10:40:36.896362 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 364/718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:36 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:36.899904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:36.899904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:36.916178 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:36.916477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:36.916950 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:36.917660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:36.918114 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:36.918537 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:36.921382 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:37.150803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:37.164618 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:37.166310 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:37.167510 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3f3fe771-b257-46fe-b2ff-6e6f55bd241a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.273732 Oct 04 10:40:37.168066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 355/719] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:36 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:37.719444 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:37.720094 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:37.726477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:37.726963 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:37.727454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:37.728101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:37.728556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:37.729009 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:37.919688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:37.920452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:37.927709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:37.928265 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:37.928844 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:37.929643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:37.930160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:37.930653 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:38.032498 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:38.044444 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3be53bb7-f1af-40e2-85d2-aa1025dfa00c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1557 microversion: 2.1 time: 0.328797 Oct 04 10:40:38.047378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 365/720] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:37 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1557 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:38.070726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:38.070726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:38.076279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:38.076764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:38.077235 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:38.077936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:38.078388 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:38.078811 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:38.093347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:38.100935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:38.113755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dbc1c1dd-f9dd-4e5b-b360-d82d750f6e4b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.197703 Oct 04 10:40:38.114669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 356/721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:37 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:40:38.195860 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:38.197089 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:38.208837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:38.209420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:38.209874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:38.210824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:38.213306 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:38.213825 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:38.222752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-194a8e5a-7bc3-4cdb-9889-7928803132d1 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156850 Oct 04 10:40:38.231965 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 366/722] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 10:40:38 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:38.473934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:38.494572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:38.495334 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:38.496588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d53561ef-e849-49f8-861d-e95b04feed06 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.307073 Oct 04 10:40:38.497671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 357/723] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:38 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:40:39.145860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:39.145860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:39.145860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:39.145860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:39.147080 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:39.147080 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:39.147434 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:39.148051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:39.459772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:39.468022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f193b8c2-234b-4343-891b-c837478b9ec0 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.333897 Oct 04 10:40:39.468584 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 367/724] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:39 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:39.524386 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:39.525187 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:39.531786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:39.532631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:39.534094 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:39.535123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:39.537057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:39.537596 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:39.691230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:39.699883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:39.701335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:39.702550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8715c672-c53f-4744-9ea6-491cb687dd14 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1743 microversion: 2.20 time: 0.182729 Oct 04 10:40:39.703134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 358/725] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:39 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:40.069600 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-0ff406af-8709-419e-a0c5-62661cebcdd7 req-db48d5d4-8435-4ce9-a96a-871a89cd8507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb3f146-38a2-4871-a1a3-02c7fbc9564d", "tag": "65f3a7de-e122-4cf9-9233-639242daff99"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:40.084797 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0ff406af-8709-419e-a0c5-62661cebcdd7 req-db48d5d4-8435-4ce9-a96a-871a89cd8507 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:40.085597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0ff406af-8709-419e-a0c5-62661cebcdd7 req-db48d5d4-8435-4ce9-a96a-871a89cd8507 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:40.086020 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-0ff406af-8709-419e-a0c5-62661cebcdd7 req-db48d5d4-8435-4ce9-a96a-871a89cd8507 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:40.099726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-0ff406af-8709-419e-a0c5-62661cebcdd7 req-db48d5d4-8435-4ce9-a96a-871a89cd8507 service nova] Creating event network-changed:65f3a7de-e122-4cf9-9233-639242daff99 for instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d on hv-cinder-85919 Oct 04 10:40:40.105832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-0ff406af-8709-419e-a0c5-62661cebcdd7 req-db48d5d4-8435-4ce9-a96a-871a89cd8507 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044523 Oct 04 10:40:40.107123 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 368/726] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:40.495490 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:40.496394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:40.504779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:40.507032 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:40.507428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:40.508323 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:40.508970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:40.509569 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:40.679726 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:40.690388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8bcf54eb-ce38-473f-8626-ea97d4757111 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.202255 Oct 04 10:40:40.692247 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 359/727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:40 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:40.729460 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:40.730832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:40.739672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:40.740483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:40.741116 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:40.741997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:40.742597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:40.743571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:40.951879 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:40.961856 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:40.963292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:40.964450 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-23b6fcc6-579b-4293-8361-9a7b28cb37c7 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1743 microversion: 2.20 time: 0.240400 Oct 04 10:40:40.965039 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 369/728] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:40 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1743 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:41.480066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3b113f93-0a21-4cbd-ab7e-4f61ec63db33 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Action: 'create', calling method: .version_select at 0x7f9be931e820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1961877393", "metadata": {"Type": "work"}}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3b113f93-0a21-4cbd-ab7e-4f61ec63db33 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Request method failure captured: Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 122 Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA2pG_E_Kfkb1xz7V7DYdNykEN4uoqltpBriL6oDhIMqE0FWp-hhiKZVdHW0JLr4j-F0n9_JW-zua2etnIjMvN55uWw_46Tc3d5VxAHmM6foSFsyef53tnsuhj0O3FxqQhAKwMbo1GptPv55VvXPIMSF4Bd3hwlPrSM_D4VIiM5qw40 Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:40:41.487606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0be389096ab5456f85c9f770a6bf1a42", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 0067953774cb4cabb34e5a3f7dd4e75c Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1961877393", "metadata": {"Type": "work"}}} Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: Oct 04 10:40:41.499991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1961877393', 'metadata': {'Type': 'work'}}}} Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise error Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:41.502146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 10:40:41.503854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 10:40:41.506422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 10:40:41.506422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.506422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3b113f93-0a21-4cbd-ab7e-4f61ec63db33 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:41.506422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3b113f93-0a21-4cbd-ab7e-4f61ec63db33 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127669 Oct 04 10:40:41.506422 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 360/729] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 10:40:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:40:41.506982 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2310da13-cd64-4854-b68b-acd634c47115 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Action: 'create', calling method: .version_select at 0x7f9be9362ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-998894115", "metadata": {"Type": "work"}}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2310da13-cd64-4854-b68b-acd634c47115 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Request method failure captured: Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 119 Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA2pG_E_Kfkb1xz7V7DYdNykEN4uoqltpBriL6oDhIMqE0FWp-hhiKZVdHW0JLr4j-F0n9_JW-zua2etnIjMvN55uWw_46Tc3d5VxAHmM6foSFsyef53tnsuhj0O3FxqQhAKwMbo1GptPv55VvXPIMSF4Bd3hwlPrSM_D4VIiM5qw40 Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:40:41.509470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0be389096ab5456f85c9f770a6bf1a42", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 0067953774cb4cabb34e5a3f7dd4e75c Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-998894115", "metadata": {"Type": "work"}}} Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: Oct 04 10:40:41.510980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-998894115', 'metadata': {'Type': 'work'}}}} Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise error Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi '0' Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:41.512156 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 10:40:41.519158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 10:40:41.520847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 10:40:41.520847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.520847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2310da13-cd64-4854-b68b-acd634c47115 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:41.520847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2310da13-cd64-4854-b68b-acd634c47115 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015294 Oct 04 10:40:41.520847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 370/730] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 10:40:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:40:41.524643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5be86997-8e0e-4806-b6cd-72d0a6edf3d8 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Action: 'create', calling method: .version_select at 0x7f9becd15040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1289982894", "metadata": {"Type": "work"}}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5be86997-8e0e-4806-b6cd-72d0a6edf3d8 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Request method failure captured: Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 119 Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA2pG_E_Kfkb1xz7V7DYdNykEN4uoqltpBriL6oDhIMqE0FWp-hhiKZVdHW0JLr4j-F0n9_JW-zua2etnIjMvN55uWw_46Tc3d5VxAHmM6foSFsyef53tnsuhj0O3FxqQhAKwMbo1GptPv55VvXPIMSF4Bd3hwlPrSM_D4VIiM5qw40 Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:40:41.531302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0be389096ab5456f85c9f770a6bf1a42", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 0067953774cb4cabb34e5a3f7dd4e75c Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1289982894", "metadata": {"Type": "work"}}} Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: Oct 04 10:40:41.537429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1289982894', 'metadata': {'Type': 'work'}}}} Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise error Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi '' Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:41.538885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 10:40:41.540321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 10:40:41.541884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 10:40:41.541884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.541884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5be86997-8e0e-4806-b6cd-72d0a6edf3d8 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:41.541884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5be86997-8e0e-4806-b6cd-72d0a6edf3d8 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014348 Oct 04 10:40:41.541884 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 361/731] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 10:40:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:40:41.544720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e63f4c1d-7e33-4e30-b84b-1a5e1e1f15d4 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Calling method '.version_select at 0x7f9be92f0160>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-e63f4c1d-7e33-4e30-b84b-1a5e1e1f15d4 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] HTTP exception thrown: Volume tempest-invalid-1928006290 could not be found. Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e63f4c1d-7e33-4e30-b84b-1a5e1e1f15d4 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Request method failure captured: Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1928006290 HTTP/1.1 Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA2pG_E_Kfkb1xz7V7DYdNykEN4uoqltpBriL6oDhIMqE0FWp-hhiKZVdHW0JLr4j-F0n9_JW-zua2etnIjMvN55uWw_46Tc3d5VxAHmM6foSFsyef53tnsuhj0O3FxqQhAKwMbo1GptPv55VvXPIMSF4Bd3hwlPrSM_D4VIiM5qw40 Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:40:41.578926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0be389096ab5456f85c9f770a6bf1a42", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 0067953774cb4cabb34e5a3f7dd4e75c Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Volume tempest-invalid-1928006290 could not be found. Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'tempest-invalid-1928006290'} Oct 04 10:40:41.580454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1928006290 could not be found. (HTTP 404) (Request-ID: req-bd0798cb-6cea-4495-914b-45dd8904829d) Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.581338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 10:40:41.583001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1928006290 could not be found. Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:41.584426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1928006290 could not be found. Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1928006290 could not be found. Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e63f4c1d-7e33-4e30-b84b-1a5e1e1f15d4 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Returning 404 to user: Volume tempest-invalid-1928006290 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e63f4c1d-7e33-4e30-b84b-1a5e1e1f15d4 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1928006290" status: 404 len: 99 microversion: 2.1 time: 0.037210 Oct 04 10:40:41.586284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 371/732] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 10:40:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1928006290 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:40:41.588206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c6cdf0c4-c3b7-467e-b186-8beecc559f23 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004416 Oct 04 10:40:41.588692 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 362/733] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Oct 4 10:40:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 10:40:41.597035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d29f2a1f-97aa-482d-a124-a4825b77d9cb tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003788 Oct 04 10:40:41.598056 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 372/734] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 10:40:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 10:40:41.606534 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4a017871-a782-4a7d-bd0b-e0edea5d277a tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Calling method '.version_select at 0x7f9be932c700>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:41.635645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-4a017871-a782-4a7d-bd0b-e0edea5d277a tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] HTTP exception thrown: Volume 06c8d05d-82f6-46f8-9bb6-4ccf60ca22de could not be found. Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4a017871-a782-4a7d-bd0b-e0edea5d277a tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Request method failure captured: Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/os-volumes/06c8d05d-82f6-46f8-9bb6-4ccf60ca22de HTTP/1.1 Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA2pG_E_Kfkb1xz7V7DYdNykEN4uoqltpBriL6oDhIMqE0FWp-hhiKZVdHW0JLr4j-F0n9_JW-zua2etnIjMvN55uWw_46Tc3d5VxAHmM6foSFsyef53tnsuhj0O3FxqQhAKwMbo1GptPv55VvXPIMSF4Bd3hwlPrSM_D4VIiM5qw40 Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:40:41.637594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0be389096ab5456f85c9f770a6bf1a42", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 0067953774cb4cabb34e5a3f7dd4e75c Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Volume 06c8d05d-82f6-46f8-9bb6-4ccf60ca22de could not be found. Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '06c8d05d-82f6-46f8-9bb6-4ccf60ca22de'} Oct 04 10:40:41.639147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06c8d05d-82f6-46f8-9bb6-4ccf60ca22de could not be found. (HTTP 404) (Request-ID: req-6ecce4a1-2f0e-4b5a-a9ef-34fa79f29ffe) Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.639928 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 10:40:41.641181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06c8d05d-82f6-46f8-9bb6-4ccf60ca22de could not be found. Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 10:40:41.642280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06c8d05d-82f6-46f8-9bb6-4ccf60ca22de could not be found. Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06c8d05d-82f6-46f8-9bb6-4ccf60ca22de could not be found. Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4a017871-a782-4a7d-bd0b-e0edea5d277a tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Returning 404 to user: Volume 06c8d05d-82f6-46f8-9bb6-4ccf60ca22de could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4a017871-a782-4a7d-bd0b-e0edea5d277a tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/06c8d05d-82f6-46f8-9bb6-4ccf60ca22de" status: 404 len: 109 microversion: 2.1 time: 0.036047 Oct 04 10:40:41.643420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 363/735] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:40:41 2022] DELETE /compute/v2.1/os-volumes/06c8d05d-82f6-46f8-9bb6-4ccf60ca22de => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:40:41.648510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4ae11813-6a6f-4f27-86fa-0dd64494ab78 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Calling method '.version_select at 0x7f9be92db0d0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:41.677604 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-4ae11813-6a6f-4f27-86fa-0dd64494ab78 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] HTTP exception thrown: Volume 9e15c778-637d-4300-a597-f41527648623 could not be found. Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4ae11813-6a6f-4f27-86fa-0dd64494ab78 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Request method failure captured: Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/os-volumes/9e15c778-637d-4300-a597-f41527648623 HTTP/1.1 Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA2pG_E_Kfkb1xz7V7DYdNykEN4uoqltpBriL6oDhIMqE0FWp-hhiKZVdHW0JLr4j-F0n9_JW-zua2etnIjMvN55uWw_46Tc3d5VxAHmM6foSFsyef53tnsuhj0O3FxqQhAKwMbo1GptPv55VvXPIMSF4Bd3hwlPrSM_D4VIiM5qw40 Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:40:41.679558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0be389096ab5456f85c9f770a6bf1a42", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0be389096ab5456f85c9f770a6bf1a42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 0be389096ab5456f85c9f770a6bf1a42 Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesNegativeTest-196499257 Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 0067953774cb4cabb34e5a3f7dd4e75c Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesNegativeTest-196499257-project Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Volume 9e15c778-637d-4300-a597-f41527648623 could not be found. Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '9e15c778-637d-4300-a597-f41527648623'} Oct 04 10:40:41.681192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e15c778-637d-4300-a597-f41527648623 could not be found. (HTTP 404) (Request-ID: req-0c615f34-f704-4333-bd64-60562f7febd4) Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.682198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 10:40:41.683605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e15c778-637d-4300-a597-f41527648623 could not be found. Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 10:40:41.684960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e15c778-637d-4300-a597-f41527648623 could not be found. Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e15c778-637d-4300-a597-f41527648623 could not be found. Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4ae11813-6a6f-4f27-86fa-0dd64494ab78 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] Returning 404 to user: Volume 9e15c778-637d-4300-a597-f41527648623 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4ae11813-6a6f-4f27-86fa-0dd64494ab78 tempest-VolumesNegativeTest-196499257 tempest-VolumesNegativeTest-196499257-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9e15c778-637d-4300-a597-f41527648623" status: 404 len: 109 microversion: 2.1 time: 0.036304 Oct 04 10:40:41.686311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 373/736] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:40:41 2022] GET /compute/v2.1/os-volumes/9e15c778-637d-4300-a597-f41527648623 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:40:41.718424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:41.719515 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:41.726398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:41.726877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:41.727309 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:41.727999 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:41.728452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:41.728903 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:41.864536 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:41.872454 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e9c20ffb-7b5e-42fe-9c91-90d5e5801cf3 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.158010 Oct 04 10:40:41.873031 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 364/737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:41 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:41.992086 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:41.992593 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:41.998585 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:41.999055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:41.999472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:42.000159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:42.000607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:42.001055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:42.143882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:42.152851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:42.154585 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:42.155754 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d50e37c6-6840-4eff-8a49-cc5c02337a39 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1743 microversion: 2.20 time: 0.169364 Oct 04 10:40:42.156310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 374/738] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:41 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:42.261216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-75b4f388-70b6-48d0-b0fd-aca7cb5cda55 req-25577339-ec17-45fa-b99b-9df510ae5556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211c2430-47ea-434e-bb6f-3acdc52e10cf", "tag": "6ba4270e-5e41-4049-9d52-e28b3b0d2424"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:42.271698 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-75b4f388-70b6-48d0-b0fd-aca7cb5cda55 req-25577339-ec17-45fa-b99b-9df510ae5556 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:42.272184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-75b4f388-70b6-48d0-b0fd-aca7cb5cda55 req-25577339-ec17-45fa-b99b-9df510ae5556 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:42.272620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-75b4f388-70b6-48d0-b0fd-aca7cb5cda55 req-25577339-ec17-45fa-b99b-9df510ae5556 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:42.283923 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-75b4f388-70b6-48d0-b0fd-aca7cb5cda55 req-25577339-ec17-45fa-b99b-9df510ae5556 service nova] Creating event network-changed:6ba4270e-5e41-4049-9d52-e28b3b0d2424 for instance 211c2430-47ea-434e-bb6f-3acdc52e10cf on hv-cinder-85919 Oct 04 10:40:42.289635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-75b4f388-70b6-48d0-b0fd-aca7cb5cda55 req-25577339-ec17-45fa-b99b-9df510ae5556 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164496 Oct 04 10:40:42.290435 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 365/739] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:40:42.731296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-fc36c7d6-481d-4ff0-8504-2ab9e272925d req-7abe8e0f-4513-47bd-9c89-e5ead3f6e7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefaea3d-478b-4401-a34c-74c864644738", "name": "network-vif-plugged", "status": "completed", "tag": "ff01017f-f507-44cb-a23c-fb625d92baba"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:42.742377 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fc36c7d6-481d-4ff0-8504-2ab9e272925d req-7abe8e0f-4513-47bd-9c89-e5ead3f6e7e0 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:42.742975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fc36c7d6-481d-4ff0-8504-2ab9e272925d req-7abe8e0f-4513-47bd-9c89-e5ead3f6e7e0 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:42.743513 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fc36c7d6-481d-4ff0-8504-2ab9e272925d req-7abe8e0f-4513-47bd-9c89-e5ead3f6e7e0 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:42.755534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-fc36c7d6-481d-4ff0-8504-2ab9e272925d req-7abe8e0f-4513-47bd-9c89-e5ead3f6e7e0 service nova] Creating event network-vif-plugged:ff01017f-f507-44cb-a23c-fb625d92baba for instance fefaea3d-478b-4401-a34c-74c864644738 on hv-cinder-85919 Oct 04 10:40:42.760613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-fc36c7d6-481d-4ff0-8504-2ab9e272925d req-7abe8e0f-4513-47bd-9c89-e5ead3f6e7e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Oct 04 10:40:42.761603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 375/740] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:42.897037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:42.898332 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:42.908539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:42.909652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:42.911374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:42.912742 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:42.913838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:42.914777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:43.070372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:43.078416 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-32fa2bba-6500-48e4-a300-9f0629ed1d05 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.185962 Oct 04 10:40:43.079003 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 366/741] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:42 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:43.181345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:43.185549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:43.186284 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:43.193791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:43.194283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:43.194711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:43.195518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:43.198724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:43.199457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:43.250331 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=8 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:43.354275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:43.365141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:43.367471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:43.368893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-19d30066-5b33-4cf1-85f8-033f870698bc tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.188864 Oct 04 10:40:43.369410 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 376/742] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:43 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:44.103337 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:44.104158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:44.110962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:44.111594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:44.112109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:44.112831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:44.113912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:44.114360 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:44.284071 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:44.296753 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-53a90520-37b8-4c1f-9aaa-44968cc55a99 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.197629 Oct 04 10:40:44.318090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 367/743] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:44 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:44.396170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:44.397979 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:44.406247 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:44.408074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:44.408074 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:44.409406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:44.410078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:44.410940 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:44.608411 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:44.625753 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:44.630412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:44.631644 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e38c6a31-2141-479f-89bd-23d675522760 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.239856 Oct 04 10:40:44.632203 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 377/744] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:44 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:45.330122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:45.333480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:45.345776 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:45.350507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:45.351379 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:45.353039 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:45.353828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:45.358381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:45.570085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:45.579843 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5a70f4e6-4c91-43ae-b5bc-d888329e6943 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.254761 Oct 04 10:40:45.584671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 368/745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:45 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:45.664361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:45.666149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:45.685553 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:45.686439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:45.687909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:45.688023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:45.688520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:45.689057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:45.850573 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:45.861824 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:45.864992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:45.866357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-68816395-5e72-43a5-bd62-b9a8167daff0 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.206727 Oct 04 10:40:45.867594 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 378/746] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:45 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:46.607674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:46.608310 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:46.616020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:46.617447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:46.617917 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:46.618628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:46.619081 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:46.619512 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:46.757848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:46.765936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-43c2d778-f7cd-4789-9f4d-1c3f630ef5df tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.162186 Oct 04 10:40:46.766497 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 369/747] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:46 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:46.892765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:46.893406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:46.900126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:46.900603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:46.901085 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:46.901769 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:46.902229 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:46.902633 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:47.042123 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:47.052081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:47.053943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:47.055835 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-aa266a7c-1200-4733-85c0-110bbc745d15 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.166986 Oct 04 10:40:47.056630 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 379/748] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:46 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:47.093141 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-4a253f0c-4a94-4196-b9e8-cadddc1de609 req-46b95c1f-0959-4aa5-b755-88aaf29a6cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb3f146-38a2-4871-a1a3-02c7fbc9564d", "name": "network-vif-plugged", "status": "completed", "tag": "65f3a7de-e122-4cf9-9233-639242daff99"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:47.103137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4a253f0c-4a94-4196-b9e8-cadddc1de609 req-46b95c1f-0959-4aa5-b755-88aaf29a6cbc service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:47.103649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4a253f0c-4a94-4196-b9e8-cadddc1de609 req-46b95c1f-0959-4aa5-b755-88aaf29a6cbc service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:47.104080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4a253f0c-4a94-4196-b9e8-cadddc1de609 req-46b95c1f-0959-4aa5-b755-88aaf29a6cbc service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:47.117821 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-4a253f0c-4a94-4196-b9e8-cadddc1de609 req-46b95c1f-0959-4aa5-b755-88aaf29a6cbc service nova] Creating event network-vif-plugged:65f3a7de-e122-4cf9-9233-639242daff99 for instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d on hv-cinder-85919 Oct 04 10:40:47.122814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-4a253f0c-4a94-4196-b9e8-cadddc1de609 req-46b95c1f-0959-4aa5-b755-88aaf29a6cbc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033187 Oct 04 10:40:47.123460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 370/749] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:47.790700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:47.792005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:47.799206 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:47.799693 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:47.800627 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:47.801536 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:47.802065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:47.802504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:48.046172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:48.055257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-684adb8c-6bfa-45a2-9b5f-80d299af0e62 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.269079 Oct 04 10:40:48.056078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 380/750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:47 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:48.086027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:48.087717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:48.095583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:48.096079 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:48.096556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:48.097388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:48.098361 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:48.098791 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:48.304688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:48.315363 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:48.334248 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:48.337157 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ac4d3003-0ff3-4dc5-bff2-6ac17926bac5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.258883 Oct 04 10:40:48.356877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 371/751] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:48 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:40:49.080774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:49.081571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:49.091972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:49.096647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:49.097899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:49.101120 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:49.101832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:49.102674 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:49.320885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:49.331376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6ed4c95c-3f93-4c64-ba12-f9d756d9f880 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1318 microversion: 2.1 time: 0.253959 Oct 04 10:40:49.332749 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 381/752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:49 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:49.366968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:49.367607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:49.375795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:49.377338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:49.377780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:49.379225 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:49.379858 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:49.380456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:49.617669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:49.628119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:49.633926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:49.635496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8ba43fdd-2b97-48ea-82f9-63bca9b760ed tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.273622 Oct 04 10:40:49.642319 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 372/753] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:49 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:50.358409 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:50.359007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:50.369262 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:50.369736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:50.370167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:50.370876 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:50.371310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:50.371730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:50.511736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:50.521287 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4d925779-a364-4731-9fc5-83d7cc78ebf5 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1506 microversion: 2.1 time: 0.167006 Oct 04 10:40:50.521872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 382/754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:40:50 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:40:50.558601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e52f924-f095-4106-a420-47c296b19255", "device": "/dev/sdb"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:50.561791 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:50.568516 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:50.569031 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:50.569471 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:50.570163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:50.570614 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:50.571035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:50.662263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:50.662971 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:50.669254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:50.669746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:50.670195 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:50.670887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:50.671746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:50.672017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:50.831393 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:50.841842 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:50.843415 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:50.844690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bcf64ef8-e75b-4c2a-8f8f-6218ac5e4647 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.186689 Oct 04 10:40:50.861763 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 383/755] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:50 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:40:51.445379 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8c3dc9d1-e55c-4e80-bb1c-7183c4a4aa87 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "POST /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890631 Oct 04 10:40:51.448926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 373/756] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:40:50 2022] POST /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:40:51.872340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:51.873136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:51.881960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:51.882486 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:51.883244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:51.884058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:51.884618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:51.885832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:52.055470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:52.067366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:52.069052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:52.070405 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-80c96c40-6f4c-417c-aa66-f6d6ae017a23 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.201968 Oct 04 10:40:52.077465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 384/757] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:51 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:53.099392 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:53.101165 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:53.111575 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:53.113560 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:53.114937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:53.116412 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:53.117721 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:53.118542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:53.335716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:53.346045 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:53.351441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:53.351441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ecadb9f2-3aa1-4d05-a334-8b29c91ce04b tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.259248 Oct 04 10:40:53.357463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 374/758] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:53 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:54.377107 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:54.378865 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:54.397308 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:54.398072 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:54.398517 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:54.399222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:54.399677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:54.400104 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:54.583829 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:54.595101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:54.597909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:54.599770 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a96aeb78-c5b9-4541-9446-42462ead11e9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.226674 Oct 04 10:40:54.600701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 385/759] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:54 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:55.626411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:55.627018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:55.634322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:55.634806 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:55.635945 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:55.636941 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:55.637573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:55.638192 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:55.774830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:55.777419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:55.783795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:55.786070 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:55.787219 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-28514e2a-8bbe-4435-a7c1-2741b094230e tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1738 microversion: 2.20 time: 0.165260 Oct 04 10:40:55.787766 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 375/760] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:55 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:56.812120 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:56.812728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:56.819650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:56.820131 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:56.820571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:56.821281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:56.821732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:56.822158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:56.969800 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:56.977712 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:56.979143 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:56.980283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3adafb72-1b12-4d10-96ec-42525316e3da tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1720 microversion: 2.20 time: 0.172118 Oct 04 10:40:56.980819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 386/761] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:56 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:58.006702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:58.007427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:58.014731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:58.015217 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:58.015658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:58.016363 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:58.016808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:58.017342 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:58.177605 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:58.186082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:58.187514 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:58.188671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-48b6c920-2780-400c-afff-9557649deed6 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1720 microversion: 2.20 time: 0.186729 Oct 04 10:40:58.189313 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 376/762] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:58 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:40:59.215128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:40:59.215731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:59.222626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:59.222961 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:59.223398 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:59.224121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:59.224572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:59.225030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:59.360320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:59.372605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:59.374962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:40:59.377277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3a970f1d-90e4-4805-b991-e13e5c9fd31a tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1723 microversion: 2.20 time: 0.165696 Oct 04 10:40:59.383403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 387/763] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:40:59 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:40:59.403626 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "631fe922-3753-419a-a856-cae6c26e0c39"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:40:59.406098 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:40:59.413072 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:59.413549 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:59.413981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:40:59.414686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:40:59.415114 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:40:59.415537 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:00.528245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4220e0bd-b397-481d-9e78-dfcee20bd1b3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.128508 Oct 04 10:41:00.528948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 377/764] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Oct 4 10:40:59 2022] POST /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-volume_attachments => generated 188 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:41:00.673152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:00.673687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:00.676096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:00.681151 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:00.681638 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:00.682073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:00.682791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:00.683241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:00.683852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:00.764894 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=100 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:00.970913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-7c32937d-0a85-4164-869d-900881a5f19b req-0e36520b-7266-4214-a73b-e63b08e7f670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefaea3d-478b-4401-a34c-74c864644738", "name": "network-vif-unplugged", "status": "completed", "tag": "ff01017f-f507-44cb-a23c-fb625d92baba"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:00.983247 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-7c32937d-0a85-4164-869d-900881a5f19b req-0e36520b-7266-4214-a73b-e63b08e7f670 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:00.983733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-7c32937d-0a85-4164-869d-900881a5f19b req-0e36520b-7266-4214-a73b-e63b08e7f670 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:00.984246 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-7c32937d-0a85-4164-869d-900881a5f19b req-0e36520b-7266-4214-a73b-e63b08e7f670 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:00.996117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.compute.server_external_events [req-7c32937d-0a85-4164-869d-900881a5f19b req-0e36520b-7266-4214-a73b-e63b08e7f670 service nova] Unable to find a host for instance fefaea3d-478b-4401-a34c-74c864644738. Dropping event network-vif-unplugged {{(pid=127627) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 10:41:00.997305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-7c32937d-0a85-4164-869d-900881a5f19b req-0e36520b-7266-4214-a73b-e63b08e7f670 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.152019 Oct 04 10:41:00.997882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 378/765] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 153 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 10:41:04.059775 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-49c51510-6154-4873-b507-ad81ca60a4e5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-volume_attachments/631fe922-3753-419a-a856-cae6c26e0c39" status: 202 len: 0 microversion: 2.20 time: 3.390777 Oct 04 10:41:04.063463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 388/766] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Oct 4 10:41:00 2022] DELETE /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-volume_attachments/631fe922-3753-419a-a856-cae6c26e0c39 => generated 0 bytes in 3392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:41:04.183096 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:04.183926 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:04.186205 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=68 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:04.191156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:04.191650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:04.192084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:04.192779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:04.193262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:04.193685 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:04.227253 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127627) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 10:41:04.764645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a269aa5d-8a75-4f18-bbad-9915a16774d3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "POST /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/action" status: 202 len: 0 microversion: 2.20 time: 0.582153 Oct 04 10:41:04.764645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 379/767] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 10:41:04 2022] POST /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:41:04.770578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:04.771295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:04.779690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:04.780192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:04.780634 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:04.781369 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:04.781827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:04.782258 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:04.928940 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:04.936930 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:04.938367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:04.939510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c3fe6cc4-3bd6-43a7-8569-5d8e1ae7bd65 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1671 microversion: 2.20 time: 0.173585 Oct 04 10:41:04.940057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 389/768] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:04 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:05.967327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:05.968546 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:05.975818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:05.976567 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:05.977095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:05.978227 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:05.978750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:05.979266 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:06.168095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:06.176757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:06.178424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:06.179746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-43385d22-a89e-4b35-86a8-eb1a0fefaa33 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1671 microversion: 2.20 time: 0.217515 Oct 04 10:41:06.180453 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 380/769] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:05 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1671 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:07.205851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:07.207103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:07.214095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:07.214587 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:07.215153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:07.215880 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:07.216337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:07.216766 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:07.347808 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:07.355822 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:07.357273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:07.358436 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-98ddce9e-3d12-4b47-b2f7-a40dce7e2ac3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1671 microversion: 2.20 time: 0.156453 Oct 04 10:41:07.358959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 390/770] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:07 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:41:08.383954 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:08.384566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:08.392654 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:08.392654 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:08.393862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:08.394934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:08.395554 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:08.396149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:08.540888 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:08.549948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:08.551393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:08.552635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d265a640-79c0-4105-b916-ea539a64dcf5 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1671 microversion: 2.20 time: 0.172899 Oct 04 10:41:08.553214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 381/771] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:08 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:41:09.585864 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:09.586772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:09.593075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:09.593618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:09.594062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:09.594854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:09.595309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:09.595733 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:09.832206 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:09.839704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:09.842224 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:09.843701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5c5cec01-476a-475f-98ec-af99c8406289 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.262408 Oct 04 10:41:09.844336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 391/772] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:09 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:10.870017 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:10.870773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:10.877952 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:10.878447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:10.878883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:10.879573 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:10.880369 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:10.880814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:11.121222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:11.134382 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:11.137351 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:11.138730 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-19b0844d-1b8b-480c-ae03-e1a11ebf67ae tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.272577 Oct 04 10:41:11.145410 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 382/773] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:10 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:12.168366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:12.168942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:12.175209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:12.176193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:12.176813 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:12.177307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:12.177745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:12.178159 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:12.329873 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:12.340087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:12.341560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:12.342749 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-84806e1c-4b6c-4aba-a2bb-d27d72041bc4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.178406 Oct 04 10:41:12.343638 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 392/774] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:12 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:13.091808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:13.092383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:13.100184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:13.100678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:13.101150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:13.101891 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:13.102370 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:13.102793 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:13.194822 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lazy-loading 'services' on Instance uuid 7bb3f146-38a2-4871-a1a3-02c7fbc9564d {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:41:13.372463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:13.373157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:13.380534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:13.381760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:13.381760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:13.382194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:13.382623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:13.383039 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:13.437093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3e10277a-a473-43d8-8689-79fb1756237e tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d/os-volume_attachments/7e52f924-f095-4106-a420-47c296b19255" status: 202 len: 0 microversion: 2.1 time: 0.349281 Oct 04 10:41:13.437752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 383/775] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:41:13 2022] DELETE /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d/os-volume_attachments/7e52f924-f095-4106-a420-47c296b19255 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:41:13.532928 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:13.547849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:13.549955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:13.551383 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1b7fce89-a84e-4251-8751-5e881d8c6824 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.184827 Oct 04 10:41:13.566267 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 393/776] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:13 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:41:14.583925 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:14.584686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:14.592962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:14.593455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:14.593894 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:14.594648 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:14.595107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:14.595533 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:14.743943 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:14.752795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:14.754949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:14.756212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-69febd1d-f8f1-458c-b367-3e39f288e8fa tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.178203 Oct 04 10:41:14.757040 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 384/777] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:14 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:15.781988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:15.782708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:15.797391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:15.798036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:15.798576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:15.799517 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:15.801127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:15.801669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:15.972671 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:15.981911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:15.983507 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:15.984608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-796ed27c-d0de-475c-9aa0-76ebb416a137 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.206496 Oct 04 10:41:15.985592 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 394/778] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:15 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:17.011585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:17.012198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:17.033238 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:17.034461 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:17.035300 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:17.036467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:17.037334 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:17.038018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:17.211912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:17.231791 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:17.231791 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:17.231791 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0e99b403-82a7-478f-90c8-c343b7284868 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.216288 Oct 04 10:41:17.232258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 385/779] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:17 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:18.251330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:18.252272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:18.259813 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:18.260683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:18.262093 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:18.263052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:18.263749 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:18.264395 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:18.439027 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:18.456879 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:18.458414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:18.459574 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5f0c03f3-562c-4a19-8b6d-070e6fbe9d99 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.212790 Oct 04 10:41:18.464996 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 395/780] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:18 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:19.486255 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:19.486854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:19.494749 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:19.495237 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:19.495668 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:19.496359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:19.496807 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:19.497250 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:19.636139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:19.645466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:19.647132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:19.648411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ca3fb686-342a-4b9c-9296-b9f01c686713 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.166533 Oct 04 10:41:19.648983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 386/781] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:19 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:20.383469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:20.388086 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:20.390041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:20.390524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:20.390960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:20.391645 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:20.392095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:20.392516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:20.416645 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-af7223a3-61f0-4148-ab4d-ae439222023b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/ips" status: 200 len: 147 microversion: 2.1 time: 0.036974 Oct 04 10:41:20.417366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 396/782] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:41:20 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:20.673546 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:20.675068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:20.684423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:20.684423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:20.684423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:20.684423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:20.685010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:20.685010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:20.825528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:20.834172 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:20.835864 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:20.837042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-098008d3-5eae-49ec-b6fd-9e246c13a878 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.167310 Oct 04 10:41:20.837603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 387/783] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:20 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:21.863264 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:21.863891 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:21.870362 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:21.870851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:21.871290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:21.871983 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:21.872441 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:21.872888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:22.032793 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:22.041433 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:22.042882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:22.044083 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9cbd3dbc-50ba-4f1a-8130-4346e4fd45c2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.185231 Oct 04 10:41:22.044643 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 397/784] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:21 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:22.335376 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d78392df-dcd6-424a-a5e5-6202d2fdee90"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:22.338145 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:22.344883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:22.345088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:22.345548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:22.346228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:22.346672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:22.347086 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:22.451154 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:23.070795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:23.071316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:23.077648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:23.078124 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:23.079401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:23.079401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:23.079732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:23.080158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:23.226907 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:23.235207 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:23.236673 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:23.237844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ae1eb04d-1bb5-451f-a166-f049802a1d35 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.171802 Oct 04 10:41:23.238556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 398/785] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:23 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:23.328925 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3695680b-1710-4e52-b895-ce47a29ab5e3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995295 Oct 04 10:41:23.328925 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 388/786] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:41:22 2022] POST /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:23.359293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:23.359867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:23.367254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:23.367739 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:23.368219 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:23.368984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:23.369436 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:23.369916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:23.395361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:41:23.699892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2a101032-a2a0-4786-ac9a-4fed07cac3ff tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 204 len: 0 microversion: 2.1 time: 0.344339 Oct 04 10:41:23.700482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 399/787] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:41:23 2022] DELETE /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:41:23.710799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:23.711483 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:23.717756 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:23.718241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:23.718680 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:23.719371 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:23.719828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:23.720295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:23.855221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:23.863068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7f839a3d-7306-493a-b70d-60912af67dcd tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1512 microversion: 2.1 time: 0.157609 Oct 04 10:41:23.863626 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 389/788] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:23 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:24.273853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:24.274589 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:24.280983 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:24.281472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:24.281916 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:24.282609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:24.283073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:24.283505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:24.417192 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:24.425348 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:24.427463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:24.428792 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-15e75fe2-0bc8-4ae3-ab1a-252e7e790043 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.159232 Oct 04 10:41:24.429380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 400/789] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:24 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:24.886609 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:24.887289 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:24.893814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:24.894292 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:24.894721 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:24.896503 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:24.897056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:24.897481 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:24.988189 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:24.988772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:24.995396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:24.995960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:25.001401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:25.001401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:25.001401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:25.001401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:25.018076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:25.032456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3967d856-6184-4d4b-a567-719de078671d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/ips" status: 200 len: 149 microversion: 2.1 time: 0.045078 Oct 04 10:41:25.032456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 401/790] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 10:41:24 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:25.035474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:25.037521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-c69036d5-4580-44f3-a4e3-be0bd96dbcd5 req-83ca89ec-030e-4044-a2e2-a59588804db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefaea3d-478b-4401-a34c-74c864644738", "name": "network-vif-plugged", "status": "completed", "tag": "ff01017f-f507-44cb-a23c-fb625d92baba"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:25.045106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7f6ec4ff-5bc5-4b0b-8098-4d690828a0e1 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1512 microversion: 2.1 time: 0.162310 Oct 04 10:41:25.046127 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 390/791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:24 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:25.047439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c69036d5-4580-44f3-a4e3-be0bd96dbcd5 req-83ca89ec-030e-4044-a2e2-a59588804db7 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:25.047923 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c69036d5-4580-44f3-a4e3-be0bd96dbcd5 req-83ca89ec-030e-4044-a2e2-a59588804db7 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:25.048352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-c69036d5-4580-44f3-a4e3-be0bd96dbcd5 req-83ca89ec-030e-4044-a2e2-a59588804db7 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:25.062375 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-c69036d5-4580-44f3-a4e3-be0bd96dbcd5 req-83ca89ec-030e-4044-a2e2-a59588804db7 service nova] Creating event network-vif-plugged:ff01017f-f507-44cb-a23c-fb625d92baba for instance fefaea3d-478b-4401-a34c-74c864644738 on hv-cinder-85919 Oct 04 10:41:25.068091 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-c69036d5-4580-44f3-a4e3-be0bd96dbcd5 req-83ca89ec-030e-4044-a2e2-a59588804db7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036459 Oct 04 10:41:25.068616 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 402/792] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:25.456088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:25.456700 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:25.463106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:25.463583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:25.464044 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:25.464730 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:25.465210 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:25.465628 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:25.622206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:25.640569 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:25.640925 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:25.642681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4692a14b-9af2-4912-95d5-9db31ae8a198 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.190048 Oct 04 10:41:25.643590 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 391/793] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:25 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:26.071039 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:26.071796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:26.078414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:26.078890 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:26.079320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:26.080116 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:26.080572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:26.081045 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:26.185928 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:26.195482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3faa9b6d-6599-4cb4-90c3-67ed59dbe331 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1470 microversion: 2.1 time: 0.129939 Oct 04 10:41:26.197148 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 403/794] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:26 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1470 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:26.246545 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-6fa05cdd-0ee9-4301-8470-93535bd620a2 req-e4b4a3de-e6b4-41d2-8a09-6ec9bb568d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb3f146-38a2-4871-a1a3-02c7fbc9564d", "name": "network-vif-deleted", "tag": "65f3a7de-e122-4cf9-9233-639242daff99"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:26.257188 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-6fa05cdd-0ee9-4301-8470-93535bd620a2 req-e4b4a3de-e6b4-41d2-8a09-6ec9bb568d7c service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:26.260581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-6fa05cdd-0ee9-4301-8470-93535bd620a2 req-e4b4a3de-e6b4-41d2-8a09-6ec9bb568d7c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:26.260581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-6fa05cdd-0ee9-4301-8470-93535bd620a2 req-e4b4a3de-e6b4-41d2-8a09-6ec9bb568d7c service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:26.268924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-6fa05cdd-0ee9-4301-8470-93535bd620a2 req-e4b4a3de-e6b4-41d2-8a09-6ec9bb568d7c service nova] Creating event network-vif-deleted:65f3a7de-e122-4cf9-9233-639242daff99 for instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d on hv-cinder-85919 Oct 04 10:41:26.273758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-6fa05cdd-0ee9-4301-8470-93535bd620a2 req-e4b4a3de-e6b4-41d2-8a09-6ec9bb568d7c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031036 Oct 04 10:41:26.274332 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 392/795] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:26.672873 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:26.673485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:26.681036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:26.681616 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:26.682169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:26.683294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:26.683745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:26.684168 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:26.728187 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf6b7946-b6b5-42fc-b113-df31cfe11f29"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:26.730735 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:26.737594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:26.738289 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:26.739729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:26.740728 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:26.741434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:26.742057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:26.826738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:26.839040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:26.841045 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:26.842217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-75d89f26-2ed8-44c2-940f-4b153fa06be9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.174517 Oct 04 10:41:26.842781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 404/796] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:26 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:27.221111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:27.222406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:27.229868 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:27.235866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:27.235866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:27.235866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:27.235866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:27.236974 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:27.267787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:27.268339 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:27.268844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:27.269372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lazy-loading 'fault' on Instance uuid 7bb3f146-38a2-4871-a1a3-02c7fbc9564d {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:41:27.314163 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:27.321937 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-666470ab-2ef3-40a3-8d5b-e332fcd02664 tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1308 microversion: 2.1 time: 0.104901 Oct 04 10:41:27.337535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 405/797] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:27 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:41:27.874687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:27.874687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:27.879908 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:27.880508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:27.881157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:27.881858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:27.882318 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:27.882748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:28.022361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:28.030424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:28.031867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:28.033049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fe85edf6-8de0-46c0-bec3-77bc35143c44 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1729 microversion: 2.20 time: 0.169408 Oct 04 10:41:28.033607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 406/798] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:27 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:41:28.332457 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-982b0a07-c316-4ab9-a113-cc1a044726ee tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "POST /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.608991 Oct 04 10:41:28.334167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 393/799] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:41:26 2022] POST /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 194 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:41:28.347695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:28.348546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:28.357019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:28.357503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:28.357969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:28.358928 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:28.359559 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:28.359977 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:28.405078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:28.405078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:28.405078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:28.405078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lazy-loading 'fault' on Instance uuid 7bb3f146-38a2-4871-a1a3-02c7fbc9564d {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:41:28.441078 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d11882baae44968b8d451d6a30af87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d344597211d4f6b9a3c7961e7b0f706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:28.449465 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-59882af6-eb19-4216-ac35-5d30ec66201b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 200 len: 1308 microversion: 2.1 time: 0.107604 Oct 04 10:41:28.450035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 407/800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:28 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:29.059025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:29.059724 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:29.066507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:29.067040 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:29.067481 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:29.068174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:29.068631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:29.069095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:29.198341 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:29.206497 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:29.208544 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:29.209747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dcbd8ce5-0870-4c82-aed2-30df251ef304 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1716 microversion: 2.20 time: 0.155021 Oct 04 10:41:29.210330 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 394/801] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:41:29 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:41:29.473847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:29.474652 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] [instance: 7bb3f146-38a2-4871-a1a3-02c7fbc9564d] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:29.481113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:29.481601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:29.482041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:29.482727 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:29.483180 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:29.483602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:29.496898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] HTTP exception thrown: Instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d could not be found. Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Request method failure captured: Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d HTTP/1.1 Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA1I_fcr1Qy-BNyzVoO9RjdKCosPdKPMd7ljh5gKQFt7dFBD-76BZijNJ_Vlxsr8N4jaM7EgkY-aHiqQEcM95_PagBZ22qbpLH7zeaLG_Mhx7rm8ZsKSPgq0HDOSL14dNro-b0z78kBnzXZJZkyL4rvFVUnhhLjUmGeIhs8GPC9q_gI Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 7d344597211d4f6b9a3c7961e7b0f706 Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesSnapshotTestJSON-105377300 Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:41:29.498506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d344597211d4f6b9a3c7961e7b0f706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d344597211d4f6b9a3c7961e7b0f706", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d344597211d4f6b9a3c7961e7b0f706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d344597211d4f6b9a3c7961e7b0f706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesSnapshotTestJSON-105377300 Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 7d344597211d4f6b9a3c7961e7b0f706 Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-105377300 Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesSnapshotTestJSON-105377300-project Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: f8d11882baae44968b8d451d6a30af87 Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesSnapshotTestJSON-105377300-project Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d could not be found. Oct 04 10:41:29.500126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '7bb3f146-38a2-4871-a1a3-02c7fbc9564d'} Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d could not be found. Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:41:29.501014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d could not be found. Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d could not be found. Oct 04 10:41:29.502518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:41:29.503870 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] Returning 404 to user: Instance 7bb3f146-38a2-4871-a1a3-02c7fbc9564d could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:41:29.503870 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-93d3aa3d-05cd-4423-9557-1fa927a0ba9b tempest-VolumesSnapshotTestJSON-105377300 tempest-VolumesSnapshotTestJSON-105377300-project] 10.222.0.42 "GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d" status: 404 len: 111 microversion: 2.1 time: 0.030459 Oct 04 10:41:29.503870 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 408/802] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:29 2022] GET /compute/v2.1/servers/7bb3f146-38a2-4871-a1a3-02c7fbc9564d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:41:33.301808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:33.304430 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:33.311195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:33.311669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:33.313688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:33.313688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:33.313688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:33.314045 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:33.344190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a8896faf-8776-4125-a5e9-3269fb4fefba tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046390 Oct 04 10:41:33.344738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 395/803] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:33 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:33.355736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:33.356268 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:33.358786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:33.363951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:33.364488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:33.368955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:33.368955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:33.368955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:33.368955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:33.398599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-81c9f18a-d3d3-4991-9401-7b0c04410882 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/d78392df-dcd6-424a-a5e5-6202d2fdee90" status: 200 len: 194 microversion: 2.1 time: 0.046839 Oct 04 10:41:33.399179 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 409/804] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Oct 4 10:41:33 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/d78392df-dcd6-424a-a5e5-6202d2fdee90 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:36.606972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50011d55-3c5a-4b55-8abb-e531eb0605a2"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:36.609299 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:36.612824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:36.619418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:36.619418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:36.619418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:36.619418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:36.619800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:36.619800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:37.595878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-60788a61-b826-4d6b-9468-aeb25119d8ab tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "POST /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992830 Oct 04 10:41:37.596566 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 396/805] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:41:36 2022] POST /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:46.625153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:46.625659 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:46.628454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=44 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:46.633901 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:46.634883 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:46.635329 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:46.636037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:46.636494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:46.636947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:46.721839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lazy-loading 'services' on Instance uuid 211c2430-47ea-434e-bb6f-3acdc52e10cf {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:41:46.972799 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ca9b1ca2-7c70-4be9-bbc2-20ea49d31fe5 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments/bf6b7946-b6b5-42fc-b113-df31cfe11f29" status: 202 len: 0 microversion: 2.1 time: 0.357256 Oct 04 10:41:46.973354 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 410/806] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:41:46 2022] DELETE /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments/bf6b7946-b6b5-42fc-b113-df31cfe11f29 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:41:46.980901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:46.985478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:46.987530 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:46.994371 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:46.994846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:46.995273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:46.995960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:46.996403 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:46.996818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:47.026499 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-105da320-a7ec-4068-b1d0-f6b06bb6ca86 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047119 Oct 04 10:41:47.027047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 397/807] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:46 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:48.039537 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:48.041843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:48.047956 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:48.048430 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:48.048882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:48.049566 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:48.050012 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:48.050431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:48.080815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e6c626bf-6c1c-431d-be23-dbcdce8b059d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Oct 04 10:41:48.090595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 411/808] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:48 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:49.094000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:49.096107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:49.102601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:49.103082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:49.103513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:49.104191 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:49.104639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:49.105090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:49.134314 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-24a1d7ff-b25f-4908-8afd-1beff79f6559 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Oct 04 10:41:49.134856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 398/809] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:49 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:50.147290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:50.149987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:50.158032 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:50.158761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:50.159489 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:50.160406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:50.161363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:50.162018 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:50.195006 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ca5633ec-b53c-4b92-ae6f-0dc1a9fb7bac tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051806 Oct 04 10:41:50.195887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 412/810] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:50 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:51.207987 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:51.210076 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:51.216728 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:51.217262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:51.217699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:51.218392 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:51.218846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:51.219273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:51.249906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e2f679d3-d639-4738-ac63-30aab4c9d9e2 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045956 Oct 04 10:41:51.250464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 399/811] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:51 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:52.262103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:52.264333 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:52.270860 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:52.276626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:52.276626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:52.276626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:52.276626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:52.277100 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:52.303034 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5272fa6a-e400-4475-a033-62e657d090d7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045611 Oct 04 10:41:52.303586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 413/812] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:52 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:53.316082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:53.318279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:53.324701 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:53.325236 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:53.325672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:53.326366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:53.326818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:53.327244 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:53.329664 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:53.359098 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a3875c51-ee3e-4be0-ab5a-467bf8054ac7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Oct 04 10:41:53.366740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 400/813] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:53 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:53.918076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:53.920349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:53.928611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:53.929134 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:53.929568 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:53.931466 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:53.931925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:53.932348 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:53.971620 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-045d54d1-2642-403a-b0f0-08d144831dc6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059047 Oct 04 10:41:53.972233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 414/814] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:53 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:54.117953 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:54.117953 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:54.123967 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.124394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.124901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.125548 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.126325 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.126428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.156818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-44a48fcc-5a18-4a2c-908f-8277d06e2ec3 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/d78392df-dcd6-424a-a5e5-6202d2fdee90" status: 200 len: 194 microversion: 2.1 time: 0.045465 Oct 04 10:41:54.166334 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 401/815] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Oct 4 10:41:54 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/d78392df-dcd6-424a-a5e5-6202d2fdee90 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:54.172790 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:54.173310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:54.191471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.191471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.191471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.191471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.191885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.191885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.279272 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'services' on Instance uuid 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:41:54.372526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:54.374820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:54.381869 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.382352 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.382817 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.383615 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.384076 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.384506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.414866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e8716e48-240f-409f-a363-4eb58bdf8f8d tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045892 Oct 04 10:41:54.415418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 402/816] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:54 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 10:41:54.489053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:54.489557 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:54.496348 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.496898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.497342 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.498032 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:54.498490 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:54.498915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:54.504741 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-4c0db80a-e940-42f6-9d2d-7451c868d57c tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/d78392df-dcd6-424a-a5e5-6202d2fdee90" status: 202 len: 0 microversion: 2.1 time: 0.335762 Oct 04 10:41:54.507773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 415/817] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:41:54 2022] DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/d78392df-dcd6-424a-a5e5-6202d2fdee90 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:41:54.529452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:41:54.996353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-034fe2bd-7c8b-4922-9895-1fbb5ae3eec7 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 204 len: 0 microversion: 2.1 time: 0.511150 Oct 04 10:41:54.996876 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 403/818] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:41:54 2022] DELETE /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 10:41:55.006351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:55.007042 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:55.013389 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:55.013864 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:55.014294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:55.014975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:55.015421 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:55.015844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:55.146807 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:55.154802 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0515e09f-d4ed-42a3-a2a0-ed2ba2f75697 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1681 microversion: 2.1 time: 0.153164 Oct 04 10:41:55.155383 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 416/819] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:55 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:56.179375 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:56.181020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:56.187356 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:56.187841 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:56.188276 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:56.189006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:56.189446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:56.189939 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:56.325416 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:56.333202 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-21052d6f-92d4-4e6a-a77a-f9016d77f9fb tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1681 microversion: 2.1 time: 0.158177 Oct 04 10:41:56.333808 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 404/820] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:56 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:57.357252 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:57.358529 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:57.366624 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:57.368122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:57.368768 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:57.369672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:57.370295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:57.370880 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:57.613217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:57.623580 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2ff906fc-bee8-49b1-939b-526aa2481112 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1681 microversion: 2.1 time: 0.270003 Oct 04 10:41:57.624736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 417/821] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:57 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:57.772061 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:57.772562 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:57.781079 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:57.781193 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:57.781683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:57.782398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:57.782846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:57.783305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:57.822029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f96671eb-3847-4d01-8507-e9aaa45dd9e4 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/50011d55-3c5a-4b55-8abb-e531eb0605a2" status: 200 len: 194 microversion: 2.1 time: 0.053791 Oct 04 10:41:57.822937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 405/822] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Oct 4 10:41:57 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/50011d55-3c5a-4b55-8abb-e531eb0605a2 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:41:57.833892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:57.834813 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:57.841523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:57.842307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:57.842951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:57.843844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:57.844656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:57.845302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:57.947446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'services' on Instance uuid 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:41:58.310962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3842ae18-e5dd-4f60-842e-8166bcddadd6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/50011d55-3c5a-4b55-8abb-e531eb0605a2" status: 202 len: 0 microversion: 2.1 time: 0.480693 Oct 04 10:41:58.311700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 418/823] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:41:57 2022] DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments/50011d55-3c5a-4b55-8abb-e531eb0605a2 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:41:58.647559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:58.648177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:58.660540 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:58.661132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:58.661641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:58.662596 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:58.663163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:58.663715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:58.755855 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:58.765367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-75f6ea2f-7efe-4010-a0e5-2668225e2627 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1614 microversion: 2.1 time: 0.121633 Oct 04 10:41:58.778102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 406/824] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:58 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1614 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:41:58.788605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-a11cb5fb-33e0-4806-94d1-f29fe5bcfdbe req-acd64706-f325-41fa-95f3-08b779c76485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211c2430-47ea-434e-bb6f-3acdc52e10cf", "name": "network-vif-deleted", "tag": "6ba4270e-5e41-4049-9d52-e28b3b0d2424"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:41:58.799686 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-a11cb5fb-33e0-4806-94d1-f29fe5bcfdbe req-acd64706-f325-41fa-95f3-08b779c76485 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:58.802684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-a11cb5fb-33e0-4806-94d1-f29fe5bcfdbe req-acd64706-f325-41fa-95f3-08b779c76485 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:58.802684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-a11cb5fb-33e0-4806-94d1-f29fe5bcfdbe req-acd64706-f325-41fa-95f3-08b779c76485 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:58.812234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-a11cb5fb-33e0-4806-94d1-f29fe5bcfdbe req-acd64706-f325-41fa-95f3-08b779c76485 service nova] Creating event network-vif-deleted:6ba4270e-5e41-4049-9d52-e28b3b0d2424 for instance 211c2430-47ea-434e-bb6f-3acdc52e10cf on hv-cinder-85919 Oct 04 10:41:58.817614 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-a11cb5fb-33e0-4806-94d1-f29fe5bcfdbe req-acd64706-f325-41fa-95f3-08b779c76485 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Oct 04 10:41:58.818127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 419/825] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:41:59.524760 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:59.527031 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:59.534170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.534673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.535110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.535814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.536264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.536880 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.568459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0a32edda-b1b2-4beb-bb3c-69bfcc40947d tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047927 Oct 04 10:41:59.569303 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 407/826] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:59 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:41:59.700874 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:59.703388 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:59.709887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.710373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.711117 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.711817 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.712259 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.712677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.748731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-66d44e0a-0f31-42e2-a64a-032357d0c8d1 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051911 Oct 04 10:41:59.758569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 420/827] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:41:59 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:41:59.790579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:59.792166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:59.799857 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.800355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.801150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.801862 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.802464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.802916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.836314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:41:59.837459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:41:59.844089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.844602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.845118 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.845827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.846331 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.846946 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.856078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:41:59.856921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:41:59.857559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:41:59.858503 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lazy-loading 'fault' on Instance uuid 211c2430-47ea-434e-bb6f-3acdc52e10cf {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:41:59.879702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:41:59.911082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ed374bc664b299c1a6425dc803dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ede48c03e04fd6a00a874c318f5c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:41:59.919682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c66c78ba-1aba-43c6-b096-ae894d84d87f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 200 len: 1332 microversion: 2.1 time: 0.134553 Oct 04 10:41:59.924250 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 408/828] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:41:59 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:00.287687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-015c9fa6-e973-400b-a683-8cbbecf7155e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 204 len: 0 microversion: 2.1 time: 0.455586 Oct 04 10:42:00.288289 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 421/829] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:41:59 2022] DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 10:42:00.297014 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:00.297689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:00.303611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:00.304093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:00.305700 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:00.306423 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:00.306881 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:00.307309 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:00.440071 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:00.448056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b502fdb1-61d3-4906-9ba5-4ab178ef2209 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1674 microversion: 2.1 time: 0.154916 Oct 04 10:42:00.448625 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 409/830] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:00 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:00.944236 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:00.944966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:00.951986 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:00.952470 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:00.952928 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:00.953632 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:00.954084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:00.954516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:00.969373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf HTTP/1.1 Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:00.971022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:00.972459 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '211c2430-47ea-434e-bb6f-3acdc52e10cf'} Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:00.973322 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:00.974911 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:00.976311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:00.976311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5d323dad-68c9-4975-b655-2df54656d074 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 404 len: 111 microversion: 2.1 time: 0.032492 Oct 04 10:42:00.976311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 422/831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:00 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:00.981332 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5756bb10-2810-4e8e-874c-28d3ec3f4117 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '.version_select at 0x7f9be952b820>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:01.072089 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5756bb10-2810-4e8e-874c-28d3ec3f4117 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245436048" status: 202 len: 0 microversion: 2.1 time: 0.093821 Oct 04 10:42:01.072797 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 410/832] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 10:42:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245436048 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:42:01.471353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:01.472016 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:01.478102 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:01.478586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:01.479026 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:01.479720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:01.480178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:01.480603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:01.690217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:01.698325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fb4ada55-6326-4f7d-8efc-c496982a5c0f tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1674 microversion: 2.1 time: 0.230720 Oct 04 10:42:01.698898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 423/833] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:01 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:02.722812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:02.725598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:02.733887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:02.734373 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:02.734815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:02.735543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:02.736001 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:02.736637 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:02.870607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:02.878298 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-00656a2c-14cd-43b6-89da-64e2fae2bfd0 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1674 microversion: 2.1 time: 0.160051 Oct 04 10:42:02.878859 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 411/834] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:02 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:03.204579 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-f830c4c0-23b2-4750-8dde-ed88a76edd8f req-3f298073-f2bb-4e7f-aa2a-80a727ab8f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ea49f8-7a4d-4d16-937f-6da620fa9eb5", "name": "network-vif-deleted", "tag": "d28e774a-f971-4d5a-bcca-1c3ec025055b"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:42:03.215108 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-f830c4c0-23b2-4750-8dde-ed88a76edd8f req-3f298073-f2bb-4e7f-aa2a-80a727ab8f6f service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.215623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-f830c4c0-23b2-4750-8dde-ed88a76edd8f req-3f298073-f2bb-4e7f-aa2a-80a727ab8f6f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.216049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-f830c4c0-23b2-4750-8dde-ed88a76edd8f req-3f298073-f2bb-4e7f-aa2a-80a727ab8f6f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.221984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:03.227938 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-f830c4c0-23b2-4750-8dde-ed88a76edd8f req-3f298073-f2bb-4e7f-aa2a-80a727ab8f6f service nova] Creating event network-vif-deleted:d28e774a-f971-4d5a-bcca-1c3ec025055b for instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 on hv-cinder-85919 Oct 04 10:42:03.232786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-f830c4c0-23b2-4750-8dde-ed88a76edd8f req-3f298073-f2bb-4e7f-aa2a-80a727ab8f6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Oct 04 10:42:03.233416 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 424/835] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:42:03.268685 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:03.269385 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:03.278524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.279347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.279854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.280699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.281240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.281839 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.307223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf HTTP/1.1 Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:03.309898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.311362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '211c2430-47ea-434e-bb6f-3acdc52e10cf'} Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:03.312102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.313329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.320125 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:03.320125 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8b9ae3be-f0e3-48ae-a624-3ee09eb3b099 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 404 len: 111 microversion: 2.1 time: 0.051238 Oct 04 10:42:03.320125 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 412/836] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:42:03 2022] DELETE /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:03.326456 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:03.327436 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 211c2430-47ea-434e-bb6f-3acdc52e10cf] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:03.335401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.336233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.336805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.337536 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.337994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.338420 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.354397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf HTTP/1.1 Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:03.356145 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.357764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '211c2430-47ea-434e-bb6f-3acdc52e10cf'} Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:03.358696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. Oct 04 10:42:03.360150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:03.362172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance 211c2430-47ea-434e-bb6f-3acdc52e10cf could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:03.362172 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5e7d3fde-c997-492b-aaff-2d49a4918539 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf" status: 404 len: 111 microversion: 2.1 time: 0.036721 Oct 04 10:42:03.363056 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 425/837] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:03 2022] GET /compute/v2.1/servers/211c2430-47ea-434e-bb6f-3acdc52e10cf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:03.902837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:03.903524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:03.910310 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.910981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.911420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.912558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.913046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.913473 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.955165 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:03.955659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:03.956106 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:03.956564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lazy-loading 'fault' on Instance uuid 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:42:03.999614 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3008efcf02c644e3bc09850d6bd6eb63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7857413ab9f24988bde94f9bf52b76a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:04.008028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e80dcf11-d18d-4b83-a614-eab67a57b61e tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 200 len: 1327 microversion: 2.1 time: 0.109611 Oct 04 10:42:04.009229 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 413/838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:03 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:04.693061 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:04.693539 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:04.700646 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.701243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.701729 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.702414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.702861 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.703358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.719763 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: DELETE /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac HTTP/1.1 Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:04.721494 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.723188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '719e90e9-ee4b-4132-8f1c-c29c32a37bac'} Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:04.724910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.726658 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.728718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:04.728718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-47faf2bc-5ec4-4868-99ee-bc810392309f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 404 len: 111 microversion: 2.1 time: 0.034188 Oct 04 10:42:04.728718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 426/839] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:42:04 2022] DELETE /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:42:04.732441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:04.733254 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: 719e90e9-ee4b-4132-8f1c-c29c32a37bac] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:04.739470 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.739964 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.740397 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.741179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.741663 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.742152 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.909527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac HTTP/1.1 Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:04.911053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.912507 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '719e90e9-ee4b-4132-8f1c-c29c32a37bac'} Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:04.913479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. Oct 04 10:42:04.915485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.917280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance 719e90e9-ee4b-4132-8f1c-c29c32a37bac could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:04.917280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3710a814-3aa7-4663-a41d-76d73d1298a0 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac" status: 404 len: 111 microversion: 2.1 time: 0.184018 Oct 04 10:42:04.917280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 414/840] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:04 2022] GET /compute/v2.1/servers/719e90e9-ee4b-4132-8f1c-c29c32a37bac => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:04.921805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:04.922295 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:04.928262 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.928720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.929203 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.929926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.931069 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.931517 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.944704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: DELETE /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd HTTP/1.1 Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:04.946273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.952424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'c4069cc0-c304-4868-b731-29e1becb18bd'} Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:04.953683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.955253 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.956707 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:04.956707 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8bdb5fb3-e520-4d77-9c26-6f1db026b70c tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 404 len: 111 microversion: 2.1 time: 0.030119 Oct 04 10:42:04.956707 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 427/841] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:42:04 2022] DELETE /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:42:04.959804 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:04.960417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: c4069cc0-c304-4868-b731-29e1becb18bd] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:04.966642 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.967136 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.967571 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.968260 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:04.968709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:04.969186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:04.982707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd HTTP/1.1 Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:04.984155 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.985718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'c4069cc0-c304-4868-b731-29e1becb18bd'} Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:04.986665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. Oct 04 10:42:04.988148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:04.989727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance c4069cc0-c304-4868-b731-29e1becb18bd could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:04.989727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6ba34139-aa6c-4951-8d56-e87052d3235f tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd" status: 404 len: 111 microversion: 2.1 time: 0.031056 Oct 04 10:42:04.989727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 415/842] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:04 2022] GET /compute/v2.1/servers/c4069cc0-c304-4868-b731-29e1becb18bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:05.042828 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:05.043584 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:05.049504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:05.049991 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:05.050469 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:05.051164 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:05.051624 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:05.052056 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:05.066591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] HTTP exception thrown: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Request method failure captured: Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 HTTP/1.1 Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxnCP0mu4XX_NSFtjgQtOqgNxcYqnTejerClrO16msVwW6XASAZ0XEuNzRHKYmhKbknOO7UiyoGJJyZiwdJQKmwURvSzUDq-I2hA9F_CrZXxTngro_QLf3kyz4taY6sy1SU0osrYOlCpsAtICItbIlcU8pRFIC1E65JYudjRgXmWFE Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:05.068121 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7857413ab9f24988bde94f9bf52b76a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 3008efcf02c644e3bc09850d6bd6eb63 Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:05.069784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '63ea49f8-7a4d-4d16-937f-6da620fa9eb5'} Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:05.070611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:05.072137 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:05.073509 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Returning 404 to user: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:05.073509 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-147da7ef-652c-4fc5-9e15-73e967fd2008 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 404 len: 111 microversion: 2.1 time: 0.031451 Oct 04 10:42:05.073509 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 428/843] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:05 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:05.078457 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a35a42ac-8c7a-4bc9-9eaf-2f647fea60e8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '.version_select at 0x7f9beccb2280>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:05.220131 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a35a42ac-8c7a-4bc9-9eaf-2f647fea60e8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310980637" status: 202 len: 0 microversion: 2.1 time: 0.145351 Oct 04 10:42:05.220699 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 416/844] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 10:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310980637 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:42:06.345987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:06.346565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:06.355342 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:06.363849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:06.363849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:06.363849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:06.363849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:06.364275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:06.379244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: DELETE /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c HTTP/1.1 Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:06.380922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.382578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'd3abce48-e799-41d3-8ec2-00fc9a8e059c'} Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:06.383497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.385478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.387229 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:06.387229 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f26fd09c-257a-46d2-9691-c838442d8858 tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 404 len: 111 microversion: 2.1 time: 0.040179 Oct 04 10:42:06.387229 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 429/845] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:42:06 2022] DELETE /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:06.392679 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:06.394757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] [instance: d3abce48-e799-41d3-8ec2-00fc9a8e059c] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:06.404733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:06.405259 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:06.405705 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:06.406420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:06.406975 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:06.407414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:06.422447 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] HTTP exception thrown: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Request method failure captured: Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c HTTP/1.1 Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxk3ziIa-PWDxeGiFG6HA5_DfLt1iyeCPuS-lbhy2DL4g6BOENn0QzGiVg4CrLm6Uvt2BI-3aAL_kkRz7iDWJiJ0QW5ItmQR65PcAHyA7MBbsZhLsfH-mPPYPXqxrIMe5eXKfouKY-MrXTYjRasvx-sunqxw72FVPtmaU5Gim2kCvQ Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:06.423995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ede48c03e04fd6a00a874c318f5c3c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ede48c03e04fd6a00a874c318f5c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 29ede48c03e04fd6a00a874c318f5c3c Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41521699 Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 961ed374bc664b299c1a6425dc803dfa Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeNegativeTest-41521699-project Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.425702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'd3abce48-e799-41d3-8ec2-00fc9a8e059c'} Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:06.426498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. Oct 04 10:42:06.427688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:06.428792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] Returning 404 to user: Instance d3abce48-e799-41d3-8ec2-00fc9a8e059c could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:06.428792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-283c4ab6-2fa3-436f-9e9f-d224a2a637ce tempest-AttachVolumeNegativeTest-41521699 tempest-AttachVolumeNegativeTest-41521699-project] 10.222.0.42 "GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c" status: 404 len: 111 microversion: 2.1 time: 0.037594 Oct 04 10:42:06.428792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 417/846] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:06 2022] GET /compute/v2.1/servers/d3abce48-e799-41d3-8ec2-00fc9a8e059c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:07.582528 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:07.586173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:07.593686 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:07.594330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:07.594873 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:07.596511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:07.597201 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:07.597764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:07.634170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cfc41ff6-6991-4484-ad0d-4782d58f20d9 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054955 Oct 04 10:42:07.634780 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 430/847] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 10:42:07 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:07.707027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:07.707686 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:07.715555 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:07.716145 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:07.716643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:07.717437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:07.718210 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:07.718698 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:07.748416 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:42:07.764429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:08.118560 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f1165481-ab58-4184-a088-cb0eb72f1550 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 204 len: 0 microversion: 2.20 time: 0.415477 Oct 04 10:42:08.120549 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 418/848] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 10:42:07 2022] DELETE /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 10:42:08.128518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:08.129903 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:08.137336 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:08.138855 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:08.139951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:08.140927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:08.142259 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:08.142938 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:08.288602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:08.297861 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:08.299351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:08.300512 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0484c569-acd0-458c-b96b-52a18da812e4 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.175924 Oct 04 10:42:08.301461 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 431/849] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:42:08 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:42:08.576010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:08.577000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:08.583924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:08.584543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:08.585137 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:08.586999 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:08.588134 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:08.588640 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:08.603990 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] HTTP exception thrown: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Request method failure captured: Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 HTTP/1.1 Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxnCP0mu4XX_NSFtjgQtOqgNxcYqnTejerClrO16msVwW6XASAZ0XEuNzRHKYmhKbknOO7UiyoGJJyZiwdJQKmwURvSzUDq-I2hA9F_CrZXxTngro_QLf3kyz4taY6sy1SU0osrYOlCpsAtICItbIlcU8pRFIC1E65JYudjRgXmWFE Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:08.605780 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7857413ab9f24988bde94f9bf52b76a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 3008efcf02c644e3bc09850d6bd6eb63 Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.607167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '63ea49f8-7a4d-4d16-937f-6da620fa9eb5'} Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:08.607920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.609683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.611148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Returning 404 to user: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:08.611148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8fe21e7c-b6f2-4882-b115-bb0db024daa8 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 404 len: 111 microversion: 2.1 time: 0.038280 Oct 04 10:42:08.611148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 419/850] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:42:08 2022] DELETE /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:08.616802 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:08.617664 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: 63ea49f8-7a4d-4d16-937f-6da620fa9eb5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:08.625653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:08.626334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:08.626850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:08.627617 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:08.628279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:08.628933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:08.644575 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] HTTP exception thrown: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Request method failure captured: Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 HTTP/1.1 Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxnCP0mu4XX_NSFtjgQtOqgNxcYqnTejerClrO16msVwW6XASAZ0XEuNzRHKYmhKbknOO7UiyoGJJyZiwdJQKmwURvSzUDq-I2hA9F_CrZXxTngro_QLf3kyz4taY6sy1SU0osrYOlCpsAtICItbIlcU8pRFIC1E65JYudjRgXmWFE Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:08.646363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7857413ab9f24988bde94f9bf52b76a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 3008efcf02c644e3bc09850d6bd6eb63 Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.647909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '63ea49f8-7a4d-4d16-937f-6da620fa9eb5'} Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:08.648676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. Oct 04 10:42:08.650660 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:08.651811 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Returning 404 to user: Instance 63ea49f8-7a4d-4d16-937f-6da620fa9eb5 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:08.651811 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-733df57a-50d5-457b-bf3b-6cf284ffb6a6 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5" status: 404 len: 111 microversion: 2.1 time: 0.035089 Oct 04 10:42:08.651811 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 432/851] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:08 2022] GET /compute/v2.1/servers/63ea49f8-7a4d-4d16-937f-6da620fa9eb5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:09.326182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:09.326869 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:09.333958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:09.334520 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:09.334959 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:09.335659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:09.336414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:09.336834 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:09.542338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:09.552142 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:09.554448 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:09.556376 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d57f35aa-1bb8-4a8b-9f27-46ca87160bb2 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1722 microversion: 2.20 time: 0.234431 Oct 04 10:42:09.557504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 420/852] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:42:09 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:42:10.013400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:10.014136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:10.022396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:10.024639 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:10.024639 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:10.025139 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:10.025609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:10.026037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:10.040686 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] HTTP exception thrown: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Request method failure captured: Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: DELETE /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 HTTP/1.1 Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxnCP0mu4XX_NSFtjgQtOqgNxcYqnTejerClrO16msVwW6XASAZ0XEuNzRHKYmhKbknOO7UiyoGJJyZiwdJQKmwURvSzUDq-I2hA9F_CrZXxTngro_QLf3kyz4taY6sy1SU0osrYOlCpsAtICItbIlcU8pRFIC1E65JYudjRgXmWFE Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:10.042347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7857413ab9f24988bde94f9bf52b76a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 3008efcf02c644e3bc09850d6bd6eb63 Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.043887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'eeea5c57-433b-4799-9515-799453a51522'} Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:10.044676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.045881 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.047113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Returning 404 to user: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:10.047113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e12135dd-7387-49a9-8276-ee921729333b tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 404 len: 111 microversion: 2.1 time: 0.036656 Oct 04 10:42:10.047113 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 433/853] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:42:10 2022] DELETE /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:42:10.052256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:10.052893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] [instance: eeea5c57-433b-4799-9515-799453a51522] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:10.059343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:10.059838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:10.060279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:10.061014 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:10.061503 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:10.061935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] HTTP exception thrown: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Request method failure captured: Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 HTTP/1.1 Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxnCP0mu4XX_NSFtjgQtOqgNxcYqnTejerClrO16msVwW6XASAZ0XEuNzRHKYmhKbknOO7UiyoGJJyZiwdJQKmwURvSzUDq-I2hA9F_CrZXxTngro_QLf3kyz4taY6sy1SU0osrYOlCpsAtICItbIlcU8pRFIC1E65JYudjRgXmWFE Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:10.082102 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7857413ab9f24988bde94f9bf52b76a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7857413ab9f24988bde94f9bf52b76a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 7857413ab9f24988bde94f9bf52b76a5 Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341682175 Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 3008efcf02c644e3bc09850d6bd6eb63 Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeTestJSON-341682175-project Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.083524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'eeea5c57-433b-4799-9515-799453a51522'} Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:10.084257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. Oct 04 10:42:10.085493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:10.088140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] Returning 404 to user: Instance eeea5c57-433b-4799-9515-799453a51522 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:10.088140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-dd6cf4a3-bebc-4408-9cf4-1a704d48bd82 tempest-AttachVolumeTestJSON-341682175 tempest-AttachVolumeTestJSON-341682175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522" status: 404 len: 111 microversion: 2.1 time: 0.031848 Oct 04 10:42:10.088140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 421/854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:42:10 2022] GET /compute/v2.1/servers/eeea5c57-433b-4799-9515-799453a51522 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:42:10.590127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:10.590748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:10.597845 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:10.599088 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:10.599550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:10.600525 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:10.601041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:10.601702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:10.651730 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-a0123c53-c2f3-4e61-8e3e-124382b5410a req-893412f5-a8e5-436b-9057-3e966bfb6a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefaea3d-478b-4401-a34c-74c864644738", "name": "network-vif-deleted", "tag": "ff01017f-f507-44cb-a23c-fb625d92baba"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:42:10.671078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-a0123c53-c2f3-4e61-8e3e-124382b5410a req-893412f5-a8e5-436b-9057-3e966bfb6a22 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:10.671810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-a0123c53-c2f3-4e61-8e3e-124382b5410a req-893412f5-a8e5-436b-9057-3e966bfb6a22 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:10.672412 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-a0123c53-c2f3-4e61-8e3e-124382b5410a req-893412f5-a8e5-436b-9057-3e966bfb6a22 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:10.689466 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-a0123c53-c2f3-4e61-8e3e-124382b5410a req-893412f5-a8e5-436b-9057-3e966bfb6a22 service nova] Creating event network-vif-deleted:ff01017f-f507-44cb-a23c-fb625d92baba for instance fefaea3d-478b-4401-a34c-74c864644738 on hv-cinder-85919 Oct 04 10:42:10.698403 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-a0123c53-c2f3-4e61-8e3e-124382b5410a req-893412f5-a8e5-436b-9057-3e966bfb6a22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052269 Oct 04 10:42:10.700574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 422/855] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:42:10.702106 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:10.711181 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:10.713389 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7fcc99edab427aa2b750bf6b15b39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e605186f7944a79d36288d99d1eaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:42:10.714557 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9fc3371b-b4d5-47b6-870f-ab975d1b4b32 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 200 len: 1654 microversion: 2.20 time: 0.135747 Oct 04 10:42:10.718173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 434/856] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:42:10 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 1654 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:42:11.745324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:11.746660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:11.753630 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:11.756747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:11.756747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:11.756747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:11.756747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:11.757116 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:11.778680 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] HTTP exception thrown: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Request method failure captured: Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 HTTP/1.1 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxrfwU74xCGOLv_q7Hq1B2hm1nib2SOcP5bIEyF7bGyrEiWK3eZBDaV4FtwPFj6vvIifWdZvBgaD5xiV_fQATed_AJRLvb68K536LCHbdKy-cFf6JZrYiF-B2L1M7KYD3P654FlO2qMFo-_vyWINBjaYaum8O-mXfHOf95yFGr4lG0 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:11.782166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17e605186f7944a79d36288d99d1eaa9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 3c7fcc99edab427aa2b750bf6b15b39c Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:11.783823 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'fefaea3d-478b-4401-a34c-74c864644738'} Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:11.784734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:11.786230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:11.787532 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Returning 404 to user: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:11.787532 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cc27d6db-216e-4c37-bfef-ad3e1ad40fdd tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 404 len: 111 microversion: 2.20 time: 0.043325 Oct 04 10:42:11.787532 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 423/857] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:42:11 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:42:11.792638 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a2a330a5-b617-4208-907f-576d27bd29fb tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '.version_select at 0x7f9be92a0820>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:11.910996 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a2a330a5-b617-4208-907f-576d27bd29fb tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-795972874" status: 204 len: 0 microversion: 2.20 time: 0.121924 Oct 04 10:42:11.915196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 435/858] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Oct 4 10:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-795972874 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 10:42:14.232068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:14.232635 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:14.239745 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:14.242703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:14.242703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:14.242703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:14.242703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:14.243037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:14.258076 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] HTTP exception thrown: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Request method failure captured: Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 HTTP/1.1 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxrfwU74xCGOLv_q7Hq1B2hm1nib2SOcP5bIEyF7bGyrEiWK3eZBDaV4FtwPFj6vvIifWdZvBgaD5xiV_fQATed_AJRLvb68K536LCHbdKy-cFf6JZrYiF-B2L1M7KYD3P654FlO2qMFo-_vyWINBjaYaum8O-mXfHOf95yFGr4lG0 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:14.260812 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17e605186f7944a79d36288d99d1eaa9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 3c7fcc99edab427aa2b750bf6b15b39c Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.262417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': 'fefaea3d-478b-4401-a34c-74c864644738'} Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:14.263146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.264354 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.267174 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Returning 404 to user: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:14.268334 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d500e2f7-97e9-4dda-8145-fdd4da463d52 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 404 len: 111 microversion: 2.20 time: 0.041073 Oct 04 10:42:14.269260 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 424/859] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 10:42:14 2022] DELETE /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:42:14.279618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:14.280798 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: fefaea3d-478b-4401-a34c-74c864644738] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:14.292678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:14.292678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:14.292678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:14.292678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:14.293183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:14.293183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:14.309795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] HTTP exception thrown: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Request method failure captured: Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 HTTP/1.1 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxrfwU74xCGOLv_q7Hq1B2hm1nib2SOcP5bIEyF7bGyrEiWK3eZBDaV4FtwPFj6vvIifWdZvBgaD5xiV_fQATed_AJRLvb68K536LCHbdKy-cFf6JZrYiF-B2L1M7KYD3P654FlO2qMFo-_vyWINBjaYaum8O-mXfHOf95yFGr4lG0 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:14.311695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17e605186f7944a79d36288d99d1eaa9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 3c7fcc99edab427aa2b750bf6b15b39c Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.313418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'fefaea3d-478b-4401-a34c-74c864644738'} Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:14.314209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. Oct 04 10:42:14.315947 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:14.318431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Returning 404 to user: Instance fefaea3d-478b-4401-a34c-74c864644738 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:14.318431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-813bbaae-7560-42e6-944e-47351926b4c3 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738" status: 404 len: 111 microversion: 2.20 time: 0.039580 Oct 04 10:42:14.318431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 436/860] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:42:14 2022] GET /compute/v2.1/servers/fefaea3d-478b-4401-a34c-74c864644738 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:42:15.834186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:15.834783 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:15.845035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:15.845982 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:15.846543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:15.847419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:15.848186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:15.848764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:15.869671 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] HTTP exception thrown: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Request method failure captured: Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: DELETE /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f HTTP/1.1 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPAxrfwU74xCGOLv_q7Hq1B2hm1nib2SOcP5bIEyF7bGyrEiWK3eZBDaV4FtwPFj6vvIifWdZvBgaD5xiV_fQATed_AJRLvb68K536LCHbdKy-cFf6JZrYiF-B2L1M7KYD3P654FlO2qMFo-_vyWINBjaYaum8O-mXfHOf95yFGr4lG0 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:42:15.888209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17e605186f7944a79d36288d99d1eaa9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 3c7fcc99edab427aa2b750bf6b15b39c Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:15.890275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '64d9120a-9e5e-47d3-9c56-10fe47d51d0f'} Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:15.891115 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:15.892381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:42:15.893803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Returning 404 to user: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:15.893803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4358a1d1-617d-4501-a7a0-510997a1e843 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "DELETE /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 404 len: 111 microversion: 2.20 time: 0.045775 Oct 04 10:42:15.893803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 425/861] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 10:42:15 2022] DELETE /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:42:15.894927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:15.895535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] [instance: 64d9120a-9e5e-47d3-9c56-10fe47d51d0f] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:42:15.902946 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:15.903437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:15.903877 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:15.904592 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:42:15.905077 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:42:15.905505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:42:16.078844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] HTTP exception thrown: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Request method failure captured: Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f HTTP/1.1 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPAxrfwU74xCGOLv_q7Hq1B2hm1nib2SOcP5bIEyF7bGyrEiWK3eZBDaV4FtwPFj6vvIifWdZvBgaD5xiV_fQATed_AJRLvb68K536LCHbdKy-cFf6JZrYiF-B2L1M7KYD3P654FlO2qMFo-_vyWINBjaYaum8O-mXfHOf95yFGr4lG0 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:42:16.080827 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17e605186f7944a79d36288d99d1eaa9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17e605186f7944a79d36288d99d1eaa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 17e605186f7944a79d36288d99d1eaa9 Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1204435593 Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 3c7fcc99edab427aa2b750bf6b15b39c Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1204435593-project Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:16.082257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '64d9120a-9e5e-47d3-9c56-10fe47d51d0f'} Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:42:16.083001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. Oct 04 10:42:16.084196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:42:16.085653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] Returning 404 to user: Instance 64d9120a-9e5e-47d3-9c56-10fe47d51d0f could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:42:16.085653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ed463044-2392-4530-86da-06009713e733 tempest-AttachVolumeShelveTestJSON-1204435593 tempest-AttachVolumeShelveTestJSON-1204435593-project] 10.222.0.42 "GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f" status: 404 len: 111 microversion: 2.20 time: 0.190781 Oct 04 10:42:16.085653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 437/862] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 10:42:15 2022] GET /compute/v2.1/servers/64d9120a-9e5e-47d3-9c56-10fe47d51d0f => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:42:18.710336 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1a6c6ae5-214c-40b7-ad69-2c4a2450c9e4 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9beccb20d0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:18.759997 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1a6c6ae5-214c-40b7-ad69-2c4a2450c9e4 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/083cc81e-d6cb-410a-96d2-7b7ba209feb5" status: 200 len: 351 microversion: 2.1 time: 0.053582 Oct 04 10:42:18.760695 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 426/863] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:42:18 2022] GET /compute/v2.1/os-volumes/083cc81e-d6cb-410a-96d2-7b7ba209feb5 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:42:20.590084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5f6c0fe6-9719-438b-94f3-8992c14e1bbd tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9be9270160>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:20.638019 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5f6c0fe6-9719-438b-94f3-8992c14e1bbd tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3aa95225-95b5-41d8-be19-4f7a9f30910c" status: 200 len: 350 microversion: 2.1 time: 0.052847 Oct 04 10:42:20.638574 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 438/864] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:42:20 2022] GET /compute/v2.1/os-volumes/3aa95225-95b5-41d8-be19-4f7a9f30910c => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:42:22.444138 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b63d24ad-65de-4d06-8f6e-1c990fa66e9d tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9beccea820>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:22.497460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b63d24ad-65de-4d06-8f6e-1c990fa66e9d tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/28bdf4f1-9fe0-4ed7-be52-719b0cbe9844" status: 200 len: 351 microversion: 2.1 time: 0.056935 Oct 04 10:42:22.498018 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 427/865] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 10:42:22 2022] GET /compute/v2.1/os-volumes/28bdf4f1-9fe0-4ed7-be52-719b0cbe9844 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:42:22.513573 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-732d4041-648c-43f2-aead-e0ed7719fa7b tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9be9272dc0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:22.596685 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-732d4041-648c-43f2-aead-e0ed7719fa7b tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088905 Oct 04 10:42:22.597275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 439/866] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Oct 4 10:42:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:22.612175 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2f9fc26f-dd75-41dd-b548-42a0873090c1 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9becd150d0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:22.696028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2f9fc26f-dd75-41dd-b548-42a0873090c1 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086859 Oct 04 10:42:22.696654 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 428/867] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 10:42:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:42:22.710258 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6ef3fd83-1e47-44b6-8b83-22669bd2d47e tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9be9272550>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:22.794897 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6ef3fd83-1e47-44b6-8b83-22669bd2d47e tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088335 Oct 04 10:42:22.795455 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 440/868] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Oct 4 10:42:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:22.808436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-61d89732-4287-435c-b9e2-f72c5f51da1a tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9becd151f0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:22.891414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-61d89732-4287-435c-b9e2-f72c5f51da1a tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086736 Oct 04 10:42:22.892011 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 429/869] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Oct 4 10:42:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:42:22.907359 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f69dcb93-9265-49b0-8cf0-a828234ef91f tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9be9270790>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:22.996114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f69dcb93-9265-49b0-8cf0-a828234ef91f tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091219 Oct 04 10:42:22.996114 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 441/870] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Oct 4 10:42:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:42:23.010148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a0bb6850-7ba2-4b0b-928f-7508ba05039a tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9beccea1f0>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:23.111505 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a0bb6850-7ba2-4b0b-928f-7508ba05039a tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.105921 Oct 04 10:42:23.112063 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 430/871] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 10:42:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:42:23.128667 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1342dc79-91a8-4428-9e2c-3d93d140f557 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9be92f08b0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:23.215210 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1342dc79-91a8-4428-9e2c-3d93d140f557 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090855 Oct 04 10:42:23.215768 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 442/872] 10.222.0.42 () {58 vars in 1188 bytes} [Tue Oct 4 10:42:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:42:23.229829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-62fce1bc-3e27-4c9b-9ab3-512780a5d640 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] Calling method '.version_select at 0x7f9be9311f70>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:42:23.319574 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-62fce1bc-3e27-4c9b-9ab3-512780a5d640 tempest-VolumesTestJSON-1237772048 tempest-VolumesTestJSON-1237772048-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093846 Oct 04 10:42:23.320202 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 431/873] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 10:42:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:22.057070 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:22.057855 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=36 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:22.062255 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1430339281", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:43:22.116194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] validate_networks() for None {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:43:22.400328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:43:22.400763 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:43:22.401270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:43:22.401681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:43:22.402093 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:43:22.411144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:22.411627 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:22.412065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:22.412789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:22.413276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:22.413717 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:22.431449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Getting quotas for project eed55f7ab39c4a60ab366e77e0e1d7a0. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:43:22.435486 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Getting quotas for user 56bfa1688ede455e9ec01c5b274747c1 and project eed55f7ab39c4a60ab366e77e0e1d7a0. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:43:22.446903 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:43:22.449191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:43:22.602552 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b107063b-4ea4-489d-ab4b-ff143434c9ca tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547044 Oct 04 10:43:22.603246 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 443/874] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:43:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:43:22.612563 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:22.614188 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:22.620754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-831c6205-7330-4ebb-a0af-cfebdd1b1799 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:22.634038 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-831c6205-7330-4ebb-a0af-cfebdd1b1799 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:22.703840 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-831c6205-7330-4ebb-a0af-cfebdd1b1799 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:22.710994 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-831c6205-7330-4ebb-a0af-cfebdd1b1799 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1215 microversion: 2.1 time: 0.100662 Oct 04 10:43:22.711835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 432/875] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:22 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:23.733982 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:23.734591 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:23.741793 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:23.745002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:23.745002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:23.745002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:23.745002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:23.745391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:23.803738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:23.811431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-24f207e6-641c-4daa-9792-29c35871d68c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1219 microversion: 2.1 time: 0.081644 Oct 04 10:43:23.817193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 444/876] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:23 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:24.834355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:24.834966 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:24.843178 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:24.843716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:24.844149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:24.844930 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:24.845426 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:24.845867 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:24.906359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:24.914012 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1f553352-6c9c-42b1-a573-4c3c8f37719b tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1219 microversion: 2.1 time: 0.083558 Oct 04 10:43:24.914572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 433/877] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:24 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:25.939784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:25.940403 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:25.947151 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:25.947678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:25.948141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:25.948833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:25.949306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:25.949727 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:26.011073 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:26.020129 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7a30788c-529a-4aac-9f20-355a73f558c7 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1219 microversion: 2.1 time: 0.087203 Oct 04 10:43:26.020723 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 445/878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:25 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:27.043724 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:27.044331 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:27.051479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:27.051969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:27.052382 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:27.053093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:27.053542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:27.053962 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:27.118734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:27.132964 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-70db8258-aedd-4276-aade-7f581ebebfb3 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1267 microversion: 2.1 time: 0.087310 Oct 04 10:43:27.132964 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 434/879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:27 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:28.150935 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:28.151571 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:28.157823 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:28.158341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:28.159069 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:28.159769 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:28.160222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:28.160640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:28.231933 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:28.240165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e47ed9c0-4d97-4896-bf9e-7b3ba6b9347d tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1273 microversion: 2.1 time: 0.093415 Oct 04 10:43:28.240723 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 446/880] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:28 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:29.264056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:29.264761 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:29.277796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:29.278321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:29.278816 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:29.279526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:29.279991 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:29.280418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:29.418247 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:29.426173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-7c3bcbfb-83d7-4a81-b242-5c2d6244a820 req-40f25e41-2736-43db-9a10-63b80677fdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44c3d67-8e59-429d-8901-d065758fb41e", "tag": "f4edb4b0-3d8d-4a3e-8570-8f952ba60856"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:43:29.428661 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-823d0a80-2558-4766-8332-c16cfa340d6c tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.168765 Oct 04 10:43:29.440968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 435/881] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:29 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:29.456130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-7c3bcbfb-83d7-4a81-b242-5c2d6244a820 req-40f25e41-2736-43db-9a10-63b80677fdf2 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:29.456610 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-7c3bcbfb-83d7-4a81-b242-5c2d6244a820 req-40f25e41-2736-43db-9a10-63b80677fdf2 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:29.457164 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-7c3bcbfb-83d7-4a81-b242-5c2d6244a820 req-40f25e41-2736-43db-9a10-63b80677fdf2 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:29.468708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-7c3bcbfb-83d7-4a81-b242-5c2d6244a820 req-40f25e41-2736-43db-9a10-63b80677fdf2 service nova] Creating event network-changed:f4edb4b0-3d8d-4a3e-8570-8f952ba60856 for instance a44c3d67-8e59-429d-8901-d065758fb41e on hv-cinder-85919 Oct 04 10:43:29.474700 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-7c3bcbfb-83d7-4a81-b242-5c2d6244a820 req-40f25e41-2736-43db-9a10-63b80677fdf2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053550 Oct 04 10:43:29.475300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 447/882] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:43:30.457153 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:30.457758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:30.464457 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:30.464970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:30.465413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:30.466101 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:30.466546 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:30.466968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:30.607909 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:30.616984 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-07235fa5-5993-4dc5-bfaa-d522ae2f6d17 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.163953 Oct 04 10:43:30.617584 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 436/883] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:30 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:43:31.644250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:31.644250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:31.648131 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:31.648683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:31.649132 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:31.649833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:31.650676 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:31.650972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:31.789709 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:31.797315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3bf79449-0917-4f8b-8eb4-d2f5e3c87215 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.161488 Oct 04 10:43:31.797878 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 448/884] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:31 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:32.821976 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:32.822613 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:32.824970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:32.830243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:32.830728 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:32.831163 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:32.831853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:32.832306 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:32.832729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:32.960753 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:32.968522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-21653851-d40f-493c-8e7f-476b8b6df5c1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.150397 Oct 04 10:43:32.969110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 437/885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:32 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:33.992773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:33.993358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:33.995247 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:33.995893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=6 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:34.002731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:34.003414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:34.003893 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:34.004695 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:34.005407 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:34.008401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:34.145110 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:34.152955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9edf23bd-87d9-43af-9374-51def2dd17ad tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.164077 Oct 04 10:43:34.153371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 449/886] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:33 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:35.176139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:35.176781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:35.183549 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:35.184041 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:35.184500 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:35.185218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:35.185804 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:35.186238 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:35.323994 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:35.332162 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c3c3c05a-638c-4560-bb7b-11289d381cb1 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.160604 Oct 04 10:43:35.332717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 438/887] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:35 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:36.355599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:36.356294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:36.364038 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:36.364523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:36.364988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:36.365861 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:36.366321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:36.366736 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:36.423206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-cfc36169-7952-47cd-b661-cc9b688b3061 req-dfbb44a4-d259-4931-a3db-47262af622cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44c3d67-8e59-429d-8901-d065758fb41e", "name": "network-vif-plugged", "status": "completed", "tag": "f4edb4b0-3d8d-4a3e-8570-8f952ba60856"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:43:36.435730 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-cfc36169-7952-47cd-b661-cc9b688b3061 req-dfbb44a4-d259-4931-a3db-47262af622cf service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:36.436202 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-cfc36169-7952-47cd-b661-cc9b688b3061 req-dfbb44a4-d259-4931-a3db-47262af622cf service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:36.436711 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-cfc36169-7952-47cd-b661-cc9b688b3061 req-dfbb44a4-d259-4931-a3db-47262af622cf service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:36.449158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-cfc36169-7952-47cd-b661-cc9b688b3061 req-dfbb44a4-d259-4931-a3db-47262af622cf service nova] Creating event network-vif-plugged:f4edb4b0-3d8d-4a3e-8570-8f952ba60856 for instance a44c3d67-8e59-429d-8901-d065758fb41e on hv-cinder-85919 Oct 04 10:43:36.458834 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-cfc36169-7952-47cd-b661-cc9b688b3061 req-dfbb44a4-d259-4931-a3db-47262af622cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Oct 04 10:43:36.458834 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 439/888] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:43:36.508348 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:36.516283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-655f93e1-f421-442c-82b2-50a7f2fda96f tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.164864 Oct 04 10:43:36.516886 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 450/889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:36 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:37.545092 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:37.545789 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:37.552518 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:37.553037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:37.553475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:37.554167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:37.554620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:37.555047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:37.699398 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:37.707303 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f0d5d261-6e0a-4653-80c7-51cb328f82d0 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1315 microversion: 2.1 time: 0.166632 Oct 04 10:43:37.707854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 440/890] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:37 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:38.730141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:38.730780 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:38.737702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:38.738185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:38.739220 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:38.739953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:38.740447 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:38.740950 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:38.871309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:38.879133 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-876c75f5-2370-40a6-bfdb-4b38e4e33682 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1465 microversion: 2.1 time: 0.152844 Oct 04 10:43:38.879928 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 451/891] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:38 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:38.925268 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:38.925798 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:38.932724 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:38.933238 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:38.933665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:38.934344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:38.934794 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:38.935211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:38.960185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:43:39.263362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cf22aacd-9b85-4119-8ddc-37b2c51e9ede tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 204 len: 0 microversion: 2.1 time: 0.341469 Oct 04 10:43:39.264030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 441/892] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:43:38 2022] DELETE /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:43:39.272986 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:39.273651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:39.279520 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:39.280000 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:39.280436 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:39.281155 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:39.281608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:39.282033 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:39.411702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:39.419709 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-16c6c424-8104-42b1-a5da-f1d588a47cd5 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1471 microversion: 2.1 time: 0.151354 Oct 04 10:43:39.420369 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 452/893] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:39 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:40.443942 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:40.444602 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:40.452431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:40.452966 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:40.453411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:40.454172 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:40.454630 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:40.455088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:40.598480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:40.606682 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-513a7cbf-153d-4df5-895f-70b36eb41e6e tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1471 microversion: 2.1 time: 0.167868 Oct 04 10:43:40.607262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 442/894] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:40 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:41.446327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-917ed1b2-fcb4-439e-858f-dc422a950883 req-2ee35c47-55bb-49a7-a7e4-1ef6f04fef23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44c3d67-8e59-429d-8901-d065758fb41e", "name": "network-vif-deleted", "tag": "f4edb4b0-3d8d-4a3e-8570-8f952ba60856"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:43:41.456316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-917ed1b2-fcb4-439e-858f-dc422a950883 req-2ee35c47-55bb-49a7-a7e4-1ef6f04fef23 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:41.456885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-917ed1b2-fcb4-439e-858f-dc422a950883 req-2ee35c47-55bb-49a7-a7e4-1ef6f04fef23 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:41.457391 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-917ed1b2-fcb4-439e-858f-dc422a950883 req-2ee35c47-55bb-49a7-a7e4-1ef6f04fef23 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:41.469952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-917ed1b2-fcb4-439e-858f-dc422a950883 req-2ee35c47-55bb-49a7-a7e4-1ef6f04fef23 service nova] Creating event network-vif-deleted:f4edb4b0-3d8d-4a3e-8570-8f952ba60856 for instance a44c3d67-8e59-429d-8901-d065758fb41e on hv-cinder-85919 Oct 04 10:43:41.477330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-917ed1b2-fcb4-439e-858f-dc422a950883 req-2ee35c47-55bb-49a7-a7e4-1ef6f04fef23 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 Oct 04 10:43:41.477330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 453/895] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:43:41.641009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:41.641898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:41.651616 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:41.655409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:41.655409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:41.655409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:41.655409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:41.655938 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:41.726796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56bfa1688ede455e9ec01c5b274747c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed55f7ab39c4a60ab366e77e0e1d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:41.734355 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f548e752-a65f-45c6-8dce-d8dc19149766 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 200 len: 1300 microversion: 2.1 time: 0.098420 Oct 04 10:43:41.734915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 443/896] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:41 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:42.762696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:42.763477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] [instance: a44c3d67-8e59-429d-8901-d065758fb41e] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:42.769691 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:42.770176 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:42.771205 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:42.772103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:42.772567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:42.773084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:42.787053 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] HTTP exception thrown: Instance a44c3d67-8e59-429d-8901-d065758fb41e could not be found. Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Request method failure captured: Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e HTTP/1.1 Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA5GUMqDMjUHtJHPtGkKKrJThi0GgfZ2_bf6AeGkzAlslHiJ2D1Ftn8QUWb6edRdDEAhU3yr5GDtCtu7I5uUVuKNz2gUmfax7JoXyWfT9dFlusrHhQW-EQ64Eh1v50iiPMu6ll9n33hbB8GBCn_prNpejlE9RzL905RqF51Ctb2MoZk Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: eed55f7ab39c4a60ab366e77e0e1d7a0 Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesNegativeTest-1046091659 Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:43:42.788710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eed55f7ab39c4a60ab366e77e0e1d7a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eed55f7ab39c4a60ab366e77e0e1d7a0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eed55f7ab39c4a60ab366e77e0e1d7a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eed55f7ab39c4a60ab366e77e0e1d7a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesNegativeTest-1046091659 Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: eed55f7ab39c4a60ab366e77e0e1d7a0 Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesNegativeTest-1046091659 Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesNegativeTest-1046091659-project Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 56bfa1688ede455e9ec01c5b274747c1 Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesNegativeTest-1046091659-project Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance a44c3d67-8e59-429d-8901-d065758fb41e could not be found. Oct 04 10:43:42.790439 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'a44c3d67-8e59-429d-8901-d065758fb41e'} Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44c3d67-8e59-429d-8901-d065758fb41e could not be found. Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:43:42.791349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44c3d67-8e59-429d-8901-d065758fb41e could not be found. Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44c3d67-8e59-429d-8901-d065758fb41e could not be found. Oct 04 10:43:42.793084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:43:42.794290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] Returning 404 to user: Instance a44c3d67-8e59-429d-8901-d065758fb41e could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:43:42.794290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-eb145ca6-a4f6-4183-856b-4b886b408506 tempest-VolumesNegativeTest-1046091659 tempest-VolumesNegativeTest-1046091659-project] 10.222.0.42 "GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e" status: 404 len: 111 microversion: 2.1 time: 0.032355 Oct 04 10:43:42.795790 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 454/897] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:42 2022] GET /compute/v2.1/servers/a44c3d67-8e59-429d-8901-d065758fb41e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:43:50.513723 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-132801729", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "networks": [{"uuid": "a33bf96b-d96d-43a9-a651-e1599514d79b"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:43:50.588601 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] validate_networks() for [('a33bf96b-d96d-43a9-a651-e1599514d79b', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:43:50.671295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 10:43:50.671522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Tue Oct 4 10:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 04 10:43:51.373579 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:43:51.376264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:43:51.376264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:43:51.376264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:43:51.376264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:43:51.386286 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:51.386773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:51.387215 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:51.387943 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:51.388403 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:51.388835 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:51.407295 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Getting quotas for project 9ebfaa2af25e42b19119e2548e7b5eca. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:43:51.411402 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Getting quotas for user 3dfba289f8b449e2bada73b344056eb3 and project 9ebfaa2af25e42b19119e2548e7b5eca. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:43:51.424722 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:43:51.425714 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:43:51.592669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-79bb9a76-c286-45c6-86f5-1d16dd56af2b tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083375 Oct 04 10:43:51.593389 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 444/898] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:43:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:43:51.604701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a32ca0a7-0cea-48c0-ae6c-c1d4bc74ecdf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:51.605487 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a32ca0a7-0cea-48c0-ae6c-c1d4bc74ecdf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:51.705525 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a32ca0a7-0cea-48c0-ae6c-c1d4bc74ecdf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:51.721300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a32ca0a7-0cea-48c0-ae6c-c1d4bc74ecdf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1213 microversion: 2.1 time: 0.120105 Oct 04 10:43:51.722523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 455/899] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:51 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:52.744275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:52.745661 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:52.756240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:52.762104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:52.762748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:52.763618 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:52.764230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:52.766093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:52.833870 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:52.842698 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a6bd79a7-ba70-4f76-9e49-3e35650e916d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1217 microversion: 2.1 time: 0.102554 Oct 04 10:43:52.856882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 445/900] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:52 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:53.874216 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:53.874914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:53.887512 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=56 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:53.899169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:53.899907 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:53.909432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:53.909432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:53.909432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:53.909432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:54.080540 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:54.092732 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-1b82f55f-7106-45a1-8e13-dc9333aeef99 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1265 microversion: 2.1 time: 0.230073 Oct 04 10:43:54.105954 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 456/901] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:53 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:55.121763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:55.123529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:55.131560 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:55.132696 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:55.143924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:55.143924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:55.143924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:55.143924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:55.226642 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:55.235035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fa540a5e-161b-4691-af53-8c98de876ebf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1271 microversion: 2.1 time: 0.117764 Oct 04 10:43:55.235706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 446/902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:55 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:56.261344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:56.262243 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:56.265027 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:56.269955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:56.271834 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:56.273055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:56.274077 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:56.274601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:56.275037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:56.495437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:56.503231 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ed973132-a2d2-494c-8867-dbff98e0992d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.245713 Oct 04 10:43:56.519621 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 457/903] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:56 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:57.538013 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:57.552406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:57.552406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:57.552406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:57.552406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:57.552836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:57.552836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:57.552836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:57.552836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:57.553252 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:57.709435 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:57.717970 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-51ad9220-bd10-4c38-9408-332ae5f4f07a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.194397 Oct 04 10:43:57.733805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 447/904] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:57 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:58.319887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3bad9106-a35e-465a-95da-c615c51d0454 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Action: 'create', calling method: .version_select at 0x7f9be93a28b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1348320412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxdBYxmtNVQIj8DlFjjG6e9QR9Z89KA/jRRTDNJ1vUBqO1kqFEAeqnIPx6XVPfJFxHOGvW3cwc0Eii1c26sk1heodBHIvAdVCIBgbBJ76AD/3tee3zpHf5iTHOCaE+FaA=="}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:43:58.335928 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-3bad9106-a35e-465a-95da-c615c51d0454 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Getting quotas for project 49ae1d33c9874be780d3d55c0d2fc784. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:43:58.340998 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-3bad9106-a35e-465a-95da-c615c51d0454 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Getting quotas for user 18d0202c683747c299c3ea857f72c3f5 and project 49ae1d33c9874be780d3d55c0d2fc784. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:43:58.482560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3bad9106-a35e-465a-95da-c615c51d0454 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.390279 Oct 04 10:43:58.484213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 458/905] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:43:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:43:58.742365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:43:58.742903 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:43:58.753272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:58.753272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:58.753272 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:58.753638 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:58.753737 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:58.754165 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:58.971067 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:43:58.981121 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8c409d52-cc32-4cd7-8184-965c52cbc9a8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.242639 Oct 04 10:43:58.981854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 448/906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:43:58 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:43:59.069217 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-5d543997-7662-476a-8f38-9b6952e10856 req-faa3d550-338a-4465-b459-c289643991b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bae43d2-99c2-4891-b7df-13eca3fcfe45", "tag": "0281d55b-ca40-4ec9-8797-a579d88eef72"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:43:59.080371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5d543997-7662-476a-8f38-9b6952e10856 req-faa3d550-338a-4465-b459-c289643991b3 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:43:59.080952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5d543997-7662-476a-8f38-9b6952e10856 req-faa3d550-338a-4465-b459-c289643991b3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:43:59.081567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5d543997-7662-476a-8f38-9b6952e10856 req-faa3d550-338a-4465-b459-c289643991b3 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:43:59.093852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-5d543997-7662-476a-8f38-9b6952e10856 req-faa3d550-338a-4465-b459-c289643991b3 service nova] Creating event network-changed:0281d55b-ca40-4ec9-8797-a579d88eef72 for instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 on hv-cinder-85919 Oct 04 10:43:59.100506 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-5d543997-7662-476a-8f38-9b6952e10856 req-faa3d550-338a-4465-b459-c289643991b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Oct 04 10:43:59.101361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 459/907] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:44:00.007020 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:00.007878 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:00.015280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:00.015866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:00.016370 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:00.017758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:00.017758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:00.018209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:00.172245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:00.181085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0085caf3-78c4-40ea-8b73-805bca1a9ab8 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.178348 Oct 04 10:44:00.186893 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 449/908] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:00 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:01.209417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:01.210125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:01.216802 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:01.217255 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:01.217703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:01.218601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:01.219048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:01.219479 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:01.405677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:01.415980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0e1d04ae-13a4-4375-a31d-9c13403a6ada tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.212146 Oct 04 10:44:01.416471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 460/909] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:01 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:02.439432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:02.440212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:02.448160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:02.448160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:02.453789 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:02.454449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:02.454709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:02.455411 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:02.455861 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:02.456281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:02.607887 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:02.616713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5640f3e7-9e1a-44ce-9358-381464947439 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.181067 Oct 04 10:44:02.619895 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 450/910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:02 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:03.640615 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:03.641261 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:03.648524 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:03.649037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:03.649477 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:03.650173 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:03.650631 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:03.651090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:03.790930 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:03.798746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-43c6151f-2f5e-4363-b7de-8b65960c3345 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.161980 Oct 04 10:44:03.799312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 461/911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:03 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:04.828356 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:04.829104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:04.838521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:04.839005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:04.839442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:04.840159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:04.840608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:04.841068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:04.979984 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:04.987614 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-389c7f0b-17a5-4c2c-83d1-13949061054f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.168401 Oct 04 10:44:04.988160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 451/912] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:04 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:06.012214 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:06.012941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:06.021572 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:06.022128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:06.022927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:06.023955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:06.024418 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:06.024843 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:06.177399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:06.185900 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-732fec6f-a5a0-40cb-adec-724d6815eedf tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.177861 Oct 04 10:44:06.186480 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 462/913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:06 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:07.214069 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:07.214684 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:07.220693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:07.221206 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:07.221648 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:07.222334 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:07.222789 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:07.223342 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:07.358443 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:07.366921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-796747c1-7b58-4544-b27a-be392b1ee1f3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.157170 Oct 04 10:44:07.370913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 452/914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:07 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:08.398250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:08.398250 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:08.404230 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=6 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:08.404430 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-02275a87-b59a-4e7c-a48c-059f3ce7b5ff req-a3771c9b-b294-45e1-9684-075bdecc32e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bae43d2-99c2-4891-b7df-13eca3fcfe45", "name": "network-vif-plugged", "status": "completed", "tag": "0281d55b-ca40-4ec9-8797-a579d88eef72"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:08.406454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:08.406944 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:08.407387 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:08.408098 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:08.408554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:08.409237 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:08.421768 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-02275a87-b59a-4e7c-a48c-059f3ce7b5ff req-a3771c9b-b294-45e1-9684-075bdecc32e9 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:08.422245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-02275a87-b59a-4e7c-a48c-059f3ce7b5ff req-a3771c9b-b294-45e1-9684-075bdecc32e9 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:08.422871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-02275a87-b59a-4e7c-a48c-059f3ce7b5ff req-a3771c9b-b294-45e1-9684-075bdecc32e9 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:08.435709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-02275a87-b59a-4e7c-a48c-059f3ce7b5ff req-a3771c9b-b294-45e1-9684-075bdecc32e9 service nova] Creating event network-vif-plugged:0281d55b-ca40-4ec9-8797-a579d88eef72 for instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 on hv-cinder-85919 Oct 04 10:44:08.445035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-02275a87-b59a-4e7c-a48c-059f3ce7b5ff req-a3771c9b-b294-45e1-9684-075bdecc32e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040694 Oct 04 10:44:08.445035 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 453/915] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:44:08.573973 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:08.581795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5b2010cc-f662-4711-8b3d-89a9b4ce97ae tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.189690 Oct 04 10:44:08.582358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 463/916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:08 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:09.606615 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:09.607377 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:09.613851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:09.614345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:09.615293 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:09.616617 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:09.617110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:09.617538 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:09.759451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:09.771622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4a018afc-cf0f-48d9-994f-44125627845f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1313 microversion: 2.1 time: 0.165289 Oct 04 10:44:09.771622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 454/917] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:09 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:10.793226 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:10.793838 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:10.800597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:10.801127 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:10.801550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:10.802279 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:10.803423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:10.803857 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:10.954092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:10.963394 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9cc448bf-e781-4f1b-a5ea-091e8db385e0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1496 microversion: 2.1 time: 0.174159 Oct 04 10:44:10.963958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 464/918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:10 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1496 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:11.904141 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:11.904678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:11.911461 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:11.912543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:11.913013 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:11.913910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:11.914366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:11.914816 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:11.940356 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:44:12.263054 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4c75dc6b-22e5-4154-802d-a7176ea1316a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 204 len: 0 microversion: 2.1 time: 0.362530 Oct 04 10:44:12.263643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 455/919] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:44:11 2022] DELETE /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:44:12.273665 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:12.274286 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:12.280846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:12.281364 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:12.281800 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:12.282528 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:12.282977 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:12.283399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:12.422785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:12.430956 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c57b2ab2-7460-4f36-a216-72cc4be7e48f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1502 microversion: 2.1 time: 0.162826 Oct 04 10:44:12.431504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 465/920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:12 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:13.457097 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:13.457803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:13.465472 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:13.465948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:13.466384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:13.467167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:13.467621 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:13.468046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:13.606259 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:13.614233 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-68efa26a-a0a7-438e-8241-94c224b74585 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1502 microversion: 2.1 time: 0.161223 Oct 04 10:44:13.616124 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 456/921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:13 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:14.385562 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-b03163ef-f27d-4ccb-a762-549519c379f6 req-51e49fb0-5829-425d-a95c-fde7a2597680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bae43d2-99c2-4891-b7df-13eca3fcfe45", "name": "network-vif-deleted", "tag": "0281d55b-ca40-4ec9-8797-a579d88eef72"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:14.396478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-b03163ef-f27d-4ccb-a762-549519c379f6 req-51e49fb0-5829-425d-a95c-fde7a2597680 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:14.397093 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-b03163ef-f27d-4ccb-a762-549519c379f6 req-51e49fb0-5829-425d-a95c-fde7a2597680 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:14.397529 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-b03163ef-f27d-4ccb-a762-549519c379f6 req-51e49fb0-5829-425d-a95c-fde7a2597680 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:14.408240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-b03163ef-f27d-4ccb-a762-549519c379f6 req-51e49fb0-5829-425d-a95c-fde7a2597680 service nova] Creating event network-vif-deleted:0281d55b-ca40-4ec9-8797-a579d88eef72 for instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 on hv-cinder-85919 Oct 04 10:44:14.413298 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-b03163ef-f27d-4ccb-a762-549519c379f6 req-51e49fb0-5829-425d-a95c-fde7a2597680 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031453 Oct 04 10:44:14.413885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 466/922] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:44:14.639409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:14.640017 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:14.647470 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:14.647949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:14.648385 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:14.649129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:14.649627 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:14.650048 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:14.717179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:14.725606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4f529bbd-3343-4f95-9c37-a50ba2b2ca4a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 200 len: 1298 microversion: 2.1 time: 0.089973 Oct 04 10:44:14.726531 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 457/923] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:14 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:15.749712 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:15.750453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 8bae43d2-99c2-4891-b7df-13eca3fcfe45] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:15.757370 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:15.757857 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:15.758324 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:15.761399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:15.761399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:15.761399 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:15.773854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] HTTP exception thrown: Instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 could not be found. Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Request method failure captured: Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 HTTP/1.1 Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA5jbg0Sxzlyb0LL34DGBYCKhLJDFxSrSBeGpamzHxe0s0KNxjXC94OG3yjZqYWoJAjZQw2JjG5eqFEM3QuRKdiptfHu1XhCW9N2_ohkQ3nb66kZYvd-DLhLCXHUbtGUEVDTA8XOShTucPVjie9xuEBX231_DDUQK9DZH13JskT15iY Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 9ebfaa2af25e42b19119e2548e7b5eca Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-VolumesActionsTest-1318084182 Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:44:15.775510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ebfaa2af25e42b19119e2548e7b5eca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ebfaa2af25e42b19119e2548e7b5eca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ebfaa2af25e42b19119e2548e7b5eca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ebfaa2af25e42b19119e2548e7b5eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-VolumesActionsTest-1318084182 Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 9ebfaa2af25e42b19119e2548e7b5eca Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-VolumesActionsTest-1318084182 Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-VolumesActionsTest-1318084182-project Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 3dfba289f8b449e2bada73b344056eb3 Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-VolumesActionsTest-1318084182-project Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 could not be found. Oct 04 10:44:15.777232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '8bae43d2-99c2-4891-b7df-13eca3fcfe45'} Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 could not be found. Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:44:15.778142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 could not be found. Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 could not be found. Oct 04 10:44:15.779703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:44:15.781095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Returning 404 to user: Instance 8bae43d2-99c2-4891-b7df-13eca3fcfe45 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:44:15.781095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-dbdd464e-5908-4f0f-a978-2cdf67068901 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45" status: 404 len: 111 microversion: 2.1 time: 0.031501 Oct 04 10:44:15.781095 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 467/924] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:15 2022] GET /compute/v2.1/servers/8bae43d2-99c2-4891-b7df-13eca3fcfe45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:44:15.876080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-653434018", "imageRef": "6ef37084-03b3-4670-9aca-f5c0c2d214bc", "flavorRef": "452", "networks": [{"uuid": "a33bf96b-d96d-43a9-a651-e1599514d79b"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:15.938531 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] validate_networks() for [('a33bf96b-d96d-43a9-a651-e1599514d79b', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:44:16.335948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:44:16.336366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:44:16.337114 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:44:16.337521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:44:16.337929 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:44:16.346789 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:16.347262 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:16.347695 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:16.348407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:16.349619 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:16.350218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:16.367040 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Getting quotas for project 9ebfaa2af25e42b19119e2548e7b5eca. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:44:16.372359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Getting quotas for user 3dfba289f8b449e2bada73b344056eb3 and project 9ebfaa2af25e42b19119e2548e7b5eca. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:44:16.386449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:44:16.392367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef37084-03b3-4670-9aca-f5c0c2d214bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:44:16.567704 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1c3c14e4-ea3b-4d78-bdb0-82fb2a2229db tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695663 Oct 04 10:44:16.568655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 458/925] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:44:16.579981 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c605a109-0845-40d3-9997-ddcfccc02343 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:16.580623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c605a109-0845-40d3-9997-ddcfccc02343 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:16.648848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c605a109-0845-40d3-9997-ddcfccc02343 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:16.657060 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c605a109-0845-40d3-9997-ddcfccc02343 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1213 microversion: 2.1 time: 0.080818 Oct 04 10:44:16.658187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 468/926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:16 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:17.685183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:17.686457 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:17.696583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:17.699150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:17.699150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:17.699150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:17.700611 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:17.701325 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:17.792527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:17.800934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b203c655-9a2a-41db-8fba-2e75cda5e103 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1217 microversion: 2.1 time: 0.125137 Oct 04 10:44:17.802570 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 459/927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:17 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:18.827577 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:18.830725 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:18.841300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:18.841992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:18.842495 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:18.843282 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:18.843781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:18.844383 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:18.922604 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:18.930561 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2455f0dc-22a6-4418-9921-f6637956eaf6 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1265 microversion: 2.1 time: 0.107924 Oct 04 10:44:18.935609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 469/928] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:18 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:19.448215 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-840483398", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1348320412", "security_groups": [{"name": "tempest-secgroup-smoke-501085609"}], "networks": [{"uuid": "d3393c5b-811a-4110-8067-13335fa56255"}], "block_device_mapping_v2": [{"uuid": "e8e1f282-2b3e-46f3-bb25-bcc4a2b509b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:19.639258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] validate_networks() for [('d3393c5b-811a-4110-8067-13335fa56255', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:44:19.960167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:19.960833 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:19.968895 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:19.969433 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:19.981052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:19.983751 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:19.985639 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:19.986532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:20.248500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:20.258546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2d6669b3-ebd7-4cec-88ba-b541098bc37d tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1313 microversion: 2.1 time: 0.302943 Oct 04 10:44:20.260897 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 470/929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:19 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:20.619190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:44:20.620380 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:44:20.621127 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:44:20.621934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:44:20.622696 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:44:20.635144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:20.635774 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:20.636479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:20.637492 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:20.638230 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:20.638880 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:20.661629 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Getting quotas for project 49ae1d33c9874be780d3d55c0d2fc784. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:44:20.666820 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Getting quotas for user 18d0202c683747c299c3ea857f72c3f5 and project 49ae1d33c9874be780d3d55c0d2fc784. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:44:20.734500 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:44:20.737318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8e1f282-2b3e-46f3-bb25-bcc4a2b509b1',volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:44:21.251599 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-fb27fb32-c216-477c-8ef0-26bbd92b9224 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.808033 Oct 04 10:44:21.252613 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 460/930] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:44:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:44:21.263964 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8ff0bcad-b9b7-40f9-97e9-853e4899ce0b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:21.265251 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8ff0bcad-b9b7-40f9-97e9-853e4899ce0b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:21.284311 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:21.284981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:21.299651 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:21.304055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:21.321840 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:21.322712 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:21.323210 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:21.323652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:21.444684 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8ff0bcad-b9b7-40f9-97e9-853e4899ce0b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:21.452432 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8ff0bcad-b9b7-40f9-97e9-853e4899ce0b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1088 microversion: 2.1 time: 0.192388 Oct 04 10:44:21.465006 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 471/931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:21 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1088 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:21.572698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-828b1bb8-6a20-42a3-8eb2-2f8ab5431d92 req-8428dc63-177f-4744-a2cf-9afca8dce591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04335929-5ccf-42fd-bab0-0c64eb8ecc69", "tag": "3aa91e1f-104a-4e26-a956-d5152560d6c6"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:21.589065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-828b1bb8-6a20-42a3-8eb2-2f8ab5431d92 req-8428dc63-177f-4744-a2cf-9afca8dce591 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:21.591017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-828b1bb8-6a20-42a3-8eb2-2f8ab5431d92 req-8428dc63-177f-4744-a2cf-9afca8dce591 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:21.591724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-828b1bb8-6a20-42a3-8eb2-2f8ab5431d92 req-8428dc63-177f-4744-a2cf-9afca8dce591 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:21.596243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:21.606174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-828b1bb8-6a20-42a3-8eb2-2f8ab5431d92 req-8428dc63-177f-4744-a2cf-9afca8dce591 service nova] Creating event network-changed:3aa91e1f-104a-4e26-a956-d5152560d6c6 for instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 on hv-cinder-85919 Oct 04 10:44:21.616318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-be031c86-59d8-4025-a737-f90b4175fcbd tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1313 microversion: 2.1 time: 0.336360 Oct 04 10:44:21.618449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-828b1bb8-6a20-42a3-8eb2-2f8ab5431d92 req-8428dc63-177f-4744-a2cf-9afca8dce591 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059062 Oct 04 10:44:21.619854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 472/932] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:44:21.636221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 461/933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:21 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:22.483092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b793cbb6-2ad3-4be0-bbb6-0b4d1d90ee99 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:22.483646 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b793cbb6-2ad3-4be0-bbb6-0b4d1d90ee99 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:22.541310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b793cbb6-2ad3-4be0-bbb6-0b4d1d90ee99 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:22.548349 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b793cbb6-2ad3-4be0-bbb6-0b4d1d90ee99 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1088 microversion: 2.1 time: 0.071051 Oct 04 10:44:22.548849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 473/934] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:22 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:22.639775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:22.653762 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:22.670091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:22.670892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:22.671667 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:22.672436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:22.672912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:22.673343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:22.823445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:22.834832 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2ef82a2a-b0c3-4c8c-9c3e-6b712103f3c9 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1313 microversion: 2.1 time: 0.199039 Oct 04 10:44:22.841213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 462/935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:22 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:23.572335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:23.572335 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:23.579119 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:23.579608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:23.580085 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:23.580741 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:23.581227 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:23.581655 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:23.650105 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:23.659244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-5fc2de58-2cd6-44e2-9465-93e6b96d4bab tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1138 microversion: 2.1 time: 0.092217 Oct 04 10:44:23.659910 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 474/936] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:23 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:23.858840 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:23.859783 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:23.867604 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:23.867755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:23.868161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:23.868899 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:23.869352 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:23.869796 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:24.069502 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:24.079431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c645ab93-e5f2-43bc-b101-0c49579228f0 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1313 microversion: 2.1 time: 0.224167 Oct 04 10:44:24.093814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 463/937] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:23 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:24.684451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:24.686166 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:24.701803 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:24.702576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:24.703177 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:24.714546 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:24.715375 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:24.716170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:24.848005 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:24.864836 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-be5106f2-05b2-4e1c-aaa7-5391aef6a58e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1194 microversion: 2.1 time: 0.184684 Oct 04 10:44:24.867441 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 475/938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:24 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1194 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:25.103790 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:25.105074 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:25.111996 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:25.112469 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:25.121146 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:25.122064 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:25.122556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:25.122995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:25.139395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:25.443124 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:25.452110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-853e0aa6-b333-4337-aac7-8b51dcff6605 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1313 microversion: 2.1 time: 0.352106 Oct 04 10:44:25.453434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 464/939] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:25 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:25.900929 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:25.904615 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:25.933428 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:25.934401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:25.936031 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:25.938624 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:25.952669 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:25.955413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:26.286672 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:26.321924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=85 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:26.330692 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0b1e30e5-6a9d-430b-9b49-a7e6ad5bab3b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1271 microversion: 2.1 time: 0.441568 Oct 04 10:44:26.332065 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 476/940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:25 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1271 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:26.480413 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:26.483343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:26.493732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:26.495367 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:26.498308 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:26.502880 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:26.504161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:26.505544 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:26.795211 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-b14db5c0-73a8-455b-bb30-2c6362fe9c1d req-9ad28405-6869-4d73-8c2d-f20266230467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04335929-5ccf-42fd-bab0-0c64eb8ecc69", "name": "network-vif-plugged", "status": "completed", "tag": "3aa91e1f-104a-4e26-a956-d5152560d6c6"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:26.802530 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:26.804300 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:26.811716 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-b14db5c0-73a8-455b-bb30-2c6362fe9c1d req-9ad28405-6869-4d73-8c2d-f20266230467 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:26.813609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-b14db5c0-73a8-455b-bb30-2c6362fe9c1d req-9ad28405-6869-4d73-8c2d-f20266230467 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:26.813609 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-b14db5c0-73a8-455b-bb30-2c6362fe9c1d req-9ad28405-6869-4d73-8c2d-f20266230467 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:26.815147 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1471bd23-ac5b-4ca7-a776-f068b08c1582 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1313 microversion: 2.1 time: 0.342557 Oct 04 10:44:26.815718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 465/941] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:26 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:26.829433 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-b14db5c0-73a8-455b-bb30-2c6362fe9c1d req-9ad28405-6869-4d73-8c2d-f20266230467 service nova] Creating event network-vif-plugged:3aa91e1f-104a-4e26-a956-d5152560d6c6 for instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 on hv-cinder-85919 Oct 04 10:44:26.835338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-b14db5c0-73a8-455b-bb30-2c6362fe9c1d req-9ad28405-6869-4d73-8c2d-f20266230467 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043726 Oct 04 10:44:26.836050 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 477/942] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:44:27.361224 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:27.366669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:27.376225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-89585c97-69dd-4b99-a095-0d6a58379f2b req-c96b36b6-1fc8-4796-ab99-ca26da263045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5", "tag": "375f7f2c-8a5a-4508-b0d8-f75bb0712701"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:27.381038 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:27.381585 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:27.382604 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:27.383653 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:27.384104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:27.384736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:27.396277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-89585c97-69dd-4b99-a095-0d6a58379f2b req-c96b36b6-1fc8-4796-ab99-ca26da263045 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:27.399376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-89585c97-69dd-4b99-a095-0d6a58379f2b req-c96b36b6-1fc8-4796-ab99-ca26da263045 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:27.401361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-89585c97-69dd-4b99-a095-0d6a58379f2b req-c96b36b6-1fc8-4796-ab99-ca26da263045 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:27.433251 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-89585c97-69dd-4b99-a095-0d6a58379f2b req-c96b36b6-1fc8-4796-ab99-ca26da263045 service nova] Creating event network-changed:375f7f2c-8a5a-4508-b0d8-f75bb0712701 for instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 on hv-cinder-85919 Oct 04 10:44:27.441115 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-89585c97-69dd-4b99-a095-0d6a58379f2b req-c96b36b6-1fc8-4796-ab99-ca26da263045 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069376 Oct 04 10:44:27.443471 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 478/943] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:44:27.841923 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:27.842831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:27.859649 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:27.860281 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:27.862341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:27.862341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:27.862341 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:27.865599 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:27.951442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:27.961778 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-658f8232-89b3-400d-b612-99528376d785 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.607553 Oct 04 10:44:27.983777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 466/944] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:27 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:28.153583 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:28.163122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-166c1da3-5eab-4c56-9ddc-e336d22b6c8c tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1313 microversion: 2.1 time: 0.326487 Oct 04 10:44:28.182659 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 479/945] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:27 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:28.986497 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:28.987121 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:29.006119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:29.008528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:29.009005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:29.011511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:29.011511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:29.011511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:29.191856 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:29.194649 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:29.206984 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:29.207481 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:29.208534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:29.209259 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:29.209717 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:29.210139 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:29.288718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:29.303263 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f7856383-e2e0-4033-8338-52c77c40a6a5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.320992 Oct 04 10:44:29.325577 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 467/946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:28 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:29.408426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:29.417239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ccea1269-02bf-4d37-99cc-193c37479d1f tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1496 microversion: 2.1 time: 0.230773 Oct 04 10:44:29.417814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 480/947] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:29 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1496 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:30.331103 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:30.331713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:30.334107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:30.339159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:30.339710 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:30.340112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:30.340799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:30.341274 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:30.341691 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:30.492693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:30.500982 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-babe59cc-28d2-449d-8f22-1e34011ce8c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.173892 Oct 04 10:44:30.501569 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 468/948] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:30 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:30.536478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:30.536478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:30.543443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:30.543927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:30.544368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:30.545089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:30.545547 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:30.545988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:30.573193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:44:30.919858 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-667264ad-3101-4029-8a04-257a2ff36450 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "DELETE /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 204 len: 0 microversion: 2.1 time: 0.387594 Oct 04 10:44:30.920436 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 481/949] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:44:30 2022] DELETE /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:44:30.928801 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:30.929437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:30.931223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=4 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:30.931873 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=12 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:30.936759 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:30.937266 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:30.937698 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:30.938381 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:30.938830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:30.939250 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:31.091404 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:31.103766 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7c282be9-35fc-4243-b339-11de68ff5e65 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1502 microversion: 2.1 time: 0.179027 Oct 04 10:44:31.104876 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 469/950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:30 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:31.526303 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:31.527681 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:31.539303 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:31.539907 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:31.542903 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:31.543640 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:31.544551 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:31.547634 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:31.745987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:31.756950 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f3a8a51a-16cf-4a29-818a-54bef3baf204 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.235988 Oct 04 10:44:31.757812 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 482/951] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:31 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:32.128509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:32.129182 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:32.137605 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:32.138419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:32.139085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:32.140093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:32.140803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:32.141531 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:32.318912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:32.326913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-54127bfc-30d2-4d68-9618-8d7fa333c4d3 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1502 microversion: 2.1 time: 0.203063 Oct 04 10:44:32.328708 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 470/952] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:32 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:32.781055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:32.781687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:32.783698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=6 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:32.789777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:32.790274 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:32.790743 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:32.791426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:32.791904 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:32.792333 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:32.979197 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:32.991135 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-aff4d321-9da4-4dc6-b013-250b0d1f9212 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.213915 Oct 04 10:44:32.995966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 483/953] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:32 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:33.352914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:33.353760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:33.370273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:33.374135 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:33.374135 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:33.374135 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:33.374135 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:33.374493 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:33.415457 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-4db41dc4-e708-4fbe-9e3b-0811c7fe2f63 req-4fbcf9c6-2242-407e-a212-7c0b57987106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04335929-5ccf-42fd-bab0-0c64eb8ecc69", "name": "network-vif-deleted", "tag": "3aa91e1f-104a-4e26-a956-d5152560d6c6"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:33.437032 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4db41dc4-e708-4fbe-9e3b-0811c7fe2f63 req-4fbcf9c6-2242-407e-a212-7c0b57987106 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:33.440003 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4db41dc4-e708-4fbe-9e3b-0811c7fe2f63 req-4fbcf9c6-2242-407e-a212-7c0b57987106 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:33.440467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4db41dc4-e708-4fbe-9e3b-0811c7fe2f63 req-4fbcf9c6-2242-407e-a212-7c0b57987106 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:33.451358 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:33.461393 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f0f4f700-a425-42db-a7c1-7f69e31b6efa tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1460 microversion: 2.1 time: 0.113723 Oct 04 10:44:33.462306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 484/954] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:33 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1460 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:33.469639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-4db41dc4-e708-4fbe-9e3b-0811c7fe2f63 req-4fbcf9c6-2242-407e-a212-7c0b57987106 service nova] Creating event network-vif-deleted:3aa91e1f-104a-4e26-a956-d5152560d6c6 for instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 on hv-cinder-85919 Oct 04 10:44:33.477158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-4db41dc4-e708-4fbe-9e3b-0811c7fe2f63 req-4fbcf9c6-2242-407e-a212-7c0b57987106 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247179 Oct 04 10:44:33.477770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 471/955] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:44:34.028453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:34.029153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:34.040914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:34.041637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:34.042413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:34.043481 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:34.043952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:34.044388 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:34.226076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:34.234728 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7cc92b80-84a4-4a43-ba0b-a16fcb5e4df1 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.210636 Oct 04 10:44:34.235628 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 485/956] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:34 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:34.487066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:34.487833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:34.503424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:34.504025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:34.506654 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:34.508056 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:34.508526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:34.508992 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:34.589416 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:34.589942 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:34.590394 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:34.590848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lazy-loading 'fault' on Instance uuid 04335929-5ccf-42fd-bab0-0c64eb8ecc69 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:44:34.637744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfba289f8b449e2bada73b344056eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebfaa2af25e42b19119e2548e7b5eca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:34.656191 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6399530a-9ebf-49d3-bc73-0e3031466b15 tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 200 len: 1303 microversion: 2.1 time: 0.174414 Oct 04 10:44:34.657299 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 472/957] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:34 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:35.264825 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:35.265464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:35.273105 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:35.273823 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:35.274372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:35.275166 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:35.275683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:35.276169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:35.427312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:35.435898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a8c99b55-b6cf-4e15-8eda-4d5e01504a6e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.176388 Oct 04 10:44:35.437240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 486/958] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:35 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:35.680959 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:35.681747 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] [instance: 04335929-5ccf-42fd-bab0-0c64eb8ecc69] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:35.688167 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:35.688660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:35.692662 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:35.693497 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:35.697159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:35.697159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:35.715065 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] HTTP exception thrown: Instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 could not be found. Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Request method failure captured: Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 HTTP/1.1 Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA5jbg0Sxzlyb0LL34DGBYCKhLJDFxSrSBeGpamzHxe0s0KNxjXC94OG3yjZqYWoJAjZQw2JjG5eqFEM3QuRKdiptfHu1XhCW9N2_ohkQ3nb66kZYvd-DLhLCXHUbtGUEVDTA8XOShTucPVjie9xuEBX231_DDUQK9DZH13JskT15iY Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 9ebfaa2af25e42b19119e2548e7b5eca Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-VolumesActionsTest-1318084182 Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:44:35.717006 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ebfaa2af25e42b19119e2548e7b5eca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ebfaa2af25e42b19119e2548e7b5eca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ebfaa2af25e42b19119e2548e7b5eca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ebfaa2af25e42b19119e2548e7b5eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-VolumesActionsTest-1318084182 Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 9ebfaa2af25e42b19119e2548e7b5eca Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-VolumesActionsTest-1318084182 Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-VolumesActionsTest-1318084182-project Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 3dfba289f8b449e2bada73b344056eb3 Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-VolumesActionsTest-1318084182-project Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 could not be found. Oct 04 10:44:35.718547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '04335929-5ccf-42fd-bab0-0c64eb8ecc69'} Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 could not be found. Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:44:35.719372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 could not be found. Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 could not be found. Oct 04 10:44:35.720767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:44:35.722859 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] Returning 404 to user: Instance 04335929-5ccf-42fd-bab0-0c64eb8ecc69 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:44:35.722859 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4631c900-e784-4f70-82ef-1d9d9e04e31a tempest-VolumesActionsTest-1318084182 tempest-VolumesActionsTest-1318084182-project] 10.222.0.42 "GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69" status: 404 len: 111 microversion: 2.1 time: 0.042674 Oct 04 10:44:35.722859 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 473/959] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:35 2022] GET /compute/v2.1/servers/04335929-5ccf-42fd-bab0-0c64eb8ecc69 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:44:36.464488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:36.465122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:36.471261 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:36.471749 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:36.472186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:36.477516 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:36.478103 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:36.478545 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:36.640735 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:36.649484 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-33e67432-44fe-45f5-ace9-632826d84162 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.188891 Oct 04 10:44:36.650142 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 487/960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:36 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:37.673455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:37.674192 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:37.680251 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:37.680734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:37.681202 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:37.682019 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:37.682476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:37.682900 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:37.820775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:37.829449 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6d11fbfe-0790-4b3b-adfa-a22d699332f2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.160213 Oct 04 10:44:37.845521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 474/961] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:37 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:38.856075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:38.857333 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:38.865366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:38.865982 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:38.866505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:38.867334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:38.867800 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:38.868307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:39.024442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:39.034191 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-218d3df0-0416-49d4-acee-12def0bb795a tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.182102 Oct 04 10:44:39.035543 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 488/962] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:38 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:40.063424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:40.064197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:40.072407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:40.073218 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:40.073659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:40.074395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:40.074850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:40.075275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:40.231795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:40.246420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f0f24916-dcc7-49b9-bacd-095af14b3a40 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.186720 Oct 04 10:44:40.247271 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 475/963] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:40 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:41.273075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:41.273679 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:41.280360 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:41.280872 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:41.281330 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:41.282059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:41.282523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:41.282954 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:41.418420 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:41.426698 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-369bc5b1-d928-4860-a2ea-9e0a4bf667d4 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.158004 Oct 04 10:44:41.427710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 489/964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:41 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:41.789347 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b954f6d9-3d7c-47a8-94c9-88b56a47b802 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Action: 'create', calling method: .version_select at 0x7f9bea8fe040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-641609002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEUYpUnhy3i+uGq6fysyLJka4ehgN14K1x2JEcEvGrzyYPN4t3HlFXDf2I1Q3/3msdwodlq1jLnEkkZBZyDw3pekZhjWpUsSUxuuJHTMuRiLA/Ds6VJbkyYrNpuYBpuWw=="}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:41.824882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-b954f6d9-3d7c-47a8-94c9-88b56a47b802 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Getting quotas for project 9171bd2ad8cc4736bb8c585f40040795. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:44:41.830924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-b954f6d9-3d7c-47a8-94c9-88b56a47b802 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Getting quotas for user f5073f864387435281b00e532bf236d0 and project 9171bd2ad8cc4736bb8c585f40040795. Resources: {'key_pairs'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:44:41.844055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b954f6d9-3d7c-47a8-94c9-88b56a47b802 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [272d2b52-55fe-4366-a0e0-06743b34cc15] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 10:44:42.450794 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:42.452136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:42.464663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:42.466229 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:42.467076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:42.468232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:42.468922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:42.469576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:42.621667 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:42.630306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-da052a2d-8548-4c79-99d9-0e892f8eec01 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.182842 Oct 04 10:44:42.645791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 490/965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:42 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:42.652320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-fedb63cd-7629-4696-bb81-52aad29b5325 req-18c538eb-b01f-4716-aac8-4f652c63e511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5", "name": "network-vif-plugged", "status": "completed", "tag": "375f7f2c-8a5a-4508-b0d8-f75bb0712701"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:42.664254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fedb63cd-7629-4696-bb81-52aad29b5325 req-18c538eb-b01f-4716-aac8-4f652c63e511 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:42.664839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fedb63cd-7629-4696-bb81-52aad29b5325 req-18c538eb-b01f-4716-aac8-4f652c63e511 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:42.665362 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fedb63cd-7629-4696-bb81-52aad29b5325 req-18c538eb-b01f-4716-aac8-4f652c63e511 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:42.677409 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-fedb63cd-7629-4696-bb81-52aad29b5325 req-18c538eb-b01f-4716-aac8-4f652c63e511 service nova] Creating event network-vif-plugged:375f7f2c-8a5a-4508-b0d8-f75bb0712701 for instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 on hv-cinder-85919 Oct 04 10:44:42.682777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-fedb63cd-7629-4696-bb81-52aad29b5325 req-18c538eb-b01f-4716-aac8-4f652c63e511 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035262 Oct 04 10:44:42.683846 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 491/966] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:44:42.857007 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [None req-b954f6d9-3d7c-47a8-94c9-88b56a47b802 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [272d2b52-55fe-4366-a0e0-06743b34cc15] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36140. Oct 04 10:44:42.935471 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b954f6d9-3d7c-47a8-94c9-88b56a47b802 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.150171 Oct 04 10:44:42.942643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 476/967] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:44:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:44:42.999720 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-680478394", "imageRef": "edfbee49-bb4e-4268-b738-ceee87247bb6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-641609002", "networks": [{"uuid": "6f356257-4f59-4cc1-88b9-9b8fd85a7ad2"}]}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:43.068519 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] validate_networks() for [('6f356257-4f59-4cc1-88b9-9b8fd85a7ad2', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:44:43.558148 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:44:43.559547 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:44:43.559547 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:44:43.560099 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:44:43.560340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:44:43.573016 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:43.573992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:43.574781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:43.575777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:43.576451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:43.577154 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:43.596450 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Getting quotas for project 9171bd2ad8cc4736bb8c585f40040795. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:44:43.601648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Getting quotas for user f5073f864387435281b00e532bf236d0 and project 9171bd2ad8cc4736bb8c585f40040795. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:44:43.616151 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:44:43.619706 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='edfbee49-bb4e-4268-b738-ceee87247bb6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:44:43.655851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:43.656465 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:43.665306 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:43.665801 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:43.666241 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:43.666951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:43.667431 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:43.667866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:43.763534 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-db2cb401-c4e4-4970-9ccb-b186451cbec1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768009 Oct 04 10:44:43.765307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 492/968] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:44:43.775254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-db1143d6-1dea-42df-b9f0-0f74736106ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:43.775871 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-db1143d6-1dea-42df-b9f0-0f74736106ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:43.876776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-db1143d6-1dea-42df-b9f0-0f74736106ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:43.891634 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-db1143d6-1dea-42df-b9f0-0f74736106ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1257 microversion: 2.1 time: 0.119963 Oct 04 10:44:43.891890 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:43.896633 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 493/969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:43 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1257 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:43.915476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-35bc4c65-09b2-4e47-97cd-b23fc87d021f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1259 microversion: 2.1 time: 0.263561 Oct 04 10:44:43.916234 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 477/970] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:43 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:44:44.921271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9e14be06-0e0f-40a7-b22c-104a835653b2 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:44.923367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9e14be06-0e0f-40a7-b22c-104a835653b2 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:44.943813 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:44.944824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:44.952291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:44.953258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:44.954192 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:44.955910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:44.957795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:44.959578 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:45.012942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9e14be06-0e0f-40a7-b22c-104a835653b2 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:45.029710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9e14be06-0e0f-40a7-b22c-104a835653b2 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1257 microversion: 2.1 time: 0.105138 Oct 04 10:44:45.045275 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 494/971] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:44 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1257 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:45.167246 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:45.178047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7ac2790a-e951-47bd-87d0-ae136eeeb3bc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1443 microversion: 2.1 time: 0.240370 Oct 04 10:44:45.179475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 478/972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:44 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1443 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:45.203832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:45.204496 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:45.216342 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:45.216835 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:45.217350 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:45.218122 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:45.218607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:45.219043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:45.402915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:45.419373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-22e7d2ef-5885-4fb6-b7b3-294401476823 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1443 microversion: 2.1 time: 0.219293 Oct 04 10:44:45.424898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 495/973] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:45 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1443 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:46.053984 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:46.054590 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:46.065809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:46.066235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:46.067552 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:46.069222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:46.069860 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:46.075922 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:46.156305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:46.167693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cc2e635d-2fb0-4429-9fbf-a931ab87fd0a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1253 microversion: 2.1 time: 0.117417 Oct 04 10:44:46.169029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 479/974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:46 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1253 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:47.193084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:47.194382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:47.205677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:47.210764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:47.211823 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:47.213997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:47.215218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:47.216618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:47.241942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:47.292899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:47.302511 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-abe325c0-f276-4210-a76b-e6db583cb699 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1317 microversion: 2.1 time: 0.114886 Oct 04 10:44:47.305051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 496/975] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:47 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1317 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:48.329513 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:48.330800 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:48.338688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:48.339427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:48.340027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:48.340919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:48.341652 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:48.342240 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:48.528647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-fa43a07b-4156-4dfe-9ece-d68605768b1c req-e6b4b711-4fbc-487e-90ac-960e3c89e468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5", "tag": "375f7f2c-8a5a-4508-b0d8-f75bb0712701"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:48.536345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fa43a07b-4156-4dfe-9ece-d68605768b1c req-e6b4b711-4fbc-487e-90ac-960e3c89e468 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:48.536940 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fa43a07b-4156-4dfe-9ece-d68605768b1c req-e6b4b711-4fbc-487e-90ac-960e3c89e468 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:48.539703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-fa43a07b-4156-4dfe-9ece-d68605768b1c req-e6b4b711-4fbc-487e-90ac-960e3c89e468 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:48.571408 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-fa43a07b-4156-4dfe-9ece-d68605768b1c req-e6b4b711-4fbc-487e-90ac-960e3c89e468 service nova] Creating event network-changed:375f7f2c-8a5a-4508-b0d8-f75bb0712701 for instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 on hv-cinder-85919 Oct 04 10:44:48.588718 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-fa43a07b-4156-4dfe-9ece-d68605768b1c req-e6b4b711-4fbc-487e-90ac-960e3c89e468 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080025 Oct 04 10:44:48.593366 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 497/976] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:44:48.759885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:48.769204 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4e4c7d4e-3a44-40fc-aa21-40bd6c1f1d01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.446189 Oct 04 10:44:48.773778 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 480/977] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:48 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:49.802522 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:49.803400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:49.820235 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:49.827706 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:49.828443 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:49.830437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:49.833518 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:49.834688 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:50.143647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:50.163345 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-65503a4e-a587-4b9d-ab72-a9ac57db331a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.366699 Oct 04 10:44:50.170463 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 498/978] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:49 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:50.436223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-4cdeafff-6ba7-4dd9-bc55-41e26be40760 req-40714145-fab5-4a89-a059-8841dd873585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d52b483-a3e5-48e0-94cd-550a8ccf8050", "tag": "2b3c6bf7-5440-484c-8f3a-9e8036e84e6b"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:44:50.454839 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4cdeafff-6ba7-4dd9-bc55-41e26be40760 req-40714145-fab5-4a89-a059-8841dd873585 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:50.455322 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4cdeafff-6ba7-4dd9-bc55-41e26be40760 req-40714145-fab5-4a89-a059-8841dd873585 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:50.455755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-4cdeafff-6ba7-4dd9-bc55-41e26be40760 req-40714145-fab5-4a89-a059-8841dd873585 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:50.482814 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-4cdeafff-6ba7-4dd9-bc55-41e26be40760 req-40714145-fab5-4a89-a059-8841dd873585 service nova] Creating event network-changed:2b3c6bf7-5440-484c-8f3a-9e8036e84e6b for instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 on hv-cinder-85919 Oct 04 10:44:50.488012 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-4cdeafff-6ba7-4dd9-bc55-41e26be40760 req-40714145-fab5-4a89-a059-8841dd873585 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056487 Oct 04 10:44:50.495085 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 481/979] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:44:51.199263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:51.200754 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:51.221436 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:51.223961 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:51.224595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:51.226761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:51.227614 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:51.228761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:51.478744 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:51.487193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7b127341-8a93-4527-b2d6-2483460ac144 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.292864 Oct 04 10:44:51.497617 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 499/980] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:51 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:52.523287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=4 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:52.528591 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:52.529326 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:52.547414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:52.549075 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:52.550445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:52.552725 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:52.553873 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:52.558956 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:52.767050 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:52.775496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2ab8e16e-cd8b-43e5-801f-5681e7e834a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.255356 Oct 04 10:44:52.801428 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 482/981] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:52 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:53.810840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:53.811504 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:53.813992 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:53.820231 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:53.820730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:53.821233 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:53.822002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:53.822619 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:53.823184 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:54.023749 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:54.039588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-aaab3a3a-0e33-4e93-a2e5-107f4c5b75f1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.232250 Oct 04 10:44:54.058208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 500/982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:53 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:55.068809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:55.069593 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:55.090640 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:55.091149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:55.091594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:55.092316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:55.092776 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:55.093238 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:55.127973 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=100 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:55.271877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:55.280874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0850676a-d69f-4404-8e07-3b771222c08a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.215542 Oct 04 10:44:55.296892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 483/983] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:55 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:56.307034 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:56.307679 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:56.310326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=10 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:56.322236 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:56.324293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:56.324293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:56.324293 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:56.324713 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:56.325276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:56.568994 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:56.580899 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b8eb6c6b-8da4-4e5b-90db-377fce601aa1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.277537 Oct 04 10:44:56.584549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 501/984] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:56 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:57.609009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:57.609009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:57.615767 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:57.616567 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:57.617445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:57.618435 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:57.619109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:57.619755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:57.950190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:57.959185 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3d547d1b-c12d-49cc-82b4-21fc246ee57a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.355297 Oct 04 10:44:57.960007 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 484/985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:57 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:44:59.002618 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:44:59.005535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:44:59.015454 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:59.025622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:59.025622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:59.025622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:44:59.025622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:44:59.026037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:44:59.168361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:44:59.176820 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-03f0ee14-5a5f-4a5e-ba90-5b1a47475101 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.190553 Oct 04 10:44:59.190921 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 502/986] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:44:58 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:00.202199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:00.204845 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:00.209815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:00.209815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:00.210254 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:00.210948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:00.211395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:00.211815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:00.348324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:00.350038 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7fb14046-fa21-4af4-9f78-afcee3b60af3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.151686 Oct 04 10:45:00.350594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 485/987] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:00 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:01.373004 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:01.373620 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:01.375997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:01.381840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:01.382323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:01.382762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:01.383451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:01.383930 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:01.384333 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:01.516157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:01.525307 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ac8376e8-f755-428b-b9e1-0cc3f6b371c6 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.156139 Oct 04 10:45:01.525944 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 503/988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:01 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:02.547910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:02.548607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:02.551441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:02.557160 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:02.557715 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:02.558388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:02.559264 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:02.563442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:02.563871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:02.717914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:02.727327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-75d5c4ce-cfff-4094-af49-5d4736298d71 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.183435 Oct 04 10:45:02.728306 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 486/989] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:02 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:03.750043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:03.750585 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:03.757380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:03.757867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:03.758309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:03.759003 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:03.759458 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:03.759887 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:03.886195 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:03.893765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c9c7d209-3770-46a2-b891-c14cb31e520f tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.147663 Oct 04 10:45:03.894376 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 504/990] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:03 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:04.688053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-8024374f-5442-4910-918b-c044c4857a56 req-e1b6a679-0a81-4a48-8433-5fad2edc5480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d52b483-a3e5-48e0-94cd-550a8ccf8050", "name": "network-vif-plugged", "status": "completed", "tag": "2b3c6bf7-5440-484c-8f3a-9e8036e84e6b"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:45:04.698729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8024374f-5442-4910-918b-c044c4857a56 req-e1b6a679-0a81-4a48-8433-5fad2edc5480 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:04.699214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8024374f-5442-4910-918b-c044c4857a56 req-e1b6a679-0a81-4a48-8433-5fad2edc5480 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:04.699650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8024374f-5442-4910-918b-c044c4857a56 req-e1b6a679-0a81-4a48-8433-5fad2edc5480 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:04.713144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-8024374f-5442-4910-918b-c044c4857a56 req-e1b6a679-0a81-4a48-8433-5fad2edc5480 service nova] Creating event network-vif-plugged:2b3c6bf7-5440-484c-8f3a-9e8036e84e6b for instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 on hv-cinder-85919 Oct 04 10:45:04.718211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-8024374f-5442-4910-918b-c044c4857a56 req-e1b6a679-0a81-4a48-8433-5fad2edc5480 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034357 Oct 04 10:45:04.718847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 487/991] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:45:04.919218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:04.919835 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:04.926355 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:04.926842 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:04.927277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:04.927962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:04.928412 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:04.928889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:05.237565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:05.245731 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-680c0e3d-5f46-427d-aafd-aa8ec3a71556 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.330374 Oct 04 10:45:05.246290 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 505/992] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:04 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:06.271948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:06.272933 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:06.279421 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:06.279990 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:06.284039 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:06.284039 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:06.284039 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:06.284039 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:06.723681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:06.727527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-eda443ce-36e8-4c22-bd24-467fa9b49ec3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1357 microversion: 2.1 time: 0.461926 Oct 04 10:45:06.728273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 488/993] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:06 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1357 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:07.751531 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:07.752146 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:07.758778 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:07.762631 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:07.762631 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:07.762631 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:07.762631 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:07.763030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:07.890696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:07.898451 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-7c61a777-6fef-4699-8db3-ca19a560ce97 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1548 microversion: 2.1 time: 0.150820 Oct 04 10:45:07.899024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 506/994] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:07 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:07.920971 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:07.921683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:07.928607 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:07.929228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:07.929665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:07.930365 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:07.930848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:07.931274 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:08.063329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:08.071130 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7e6b8eb4-1127-40c7-80ee-9045db86478e tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1548 microversion: 2.1 time: 0.153976 Oct 04 10:45:08.071688 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 489/995] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:07 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:08.093793 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:08.099815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:08.100588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Searching by: {'deleted': False, 'project_id': '9171bd2ad8cc4736bb8c585f40040795'} {{(pid=127628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 10:45:08.107397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:08.107875 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:08.108310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:08.109064 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:08.109560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:08.110023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:08.210823 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.multi_cell_list [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 10:45:08.313271 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-a830cead-d941-41f0-9f0d-29141655dd0d tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223031 Oct 04 10:45:08.313884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 507/996] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 10:45:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:45:08.325864 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:08.326612 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:08.333107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:08.333596 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:08.334039 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:08.334736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:08.335199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:08.335646 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:08.481000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:08.488700 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c9410546-382f-4f5e-a3cf-645bb702eafb tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1548 microversion: 2.1 time: 0.166752 Oct 04 10:45:08.489293 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 490/997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:08 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:10.459577 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcd790e9-1894-425a-8027-e6af7c655410"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:45:10.461914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:10.468542 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:10.469063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:10.469502 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:10.470193 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:10.470649 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:10.471075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:11.226343 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9f4acd02-5186-4a5c-ab70-a3df8408bb63 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.771407 Oct 04 10:45:11.227048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 508/998] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 10:45:10 2022] POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:45:18.834242 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:18.834880 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:18.838097 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=9 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:18.838752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=41 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:18.843475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:18.843949 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:18.844378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:18.845099 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:18.845549 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:18.845969 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:18.976052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:18.984280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-49e593a5-157b-4770-859f-c6761d5fed5c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1594 microversion: 2.1 time: 0.154244 Oct 04 10:45:18.984838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 491/999] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:18 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:21.582953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:21.583868 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=11 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:21.584781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:21.588854 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-5b479156-ecd1-4495-9b07-9490eeea6875 req-0ca42748-11bf-4dc5-8b61-b23160f38076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d52b483-a3e5-48e0-94cd-550a8ccf8050", "tag": "2b3c6bf7-5440-484c-8f3a-9e8036e84e6b"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:45:21.598914 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5b479156-ecd1-4495-9b07-9490eeea6875 req-0ca42748-11bf-4dc5-8b61-b23160f38076 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:21.599395 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5b479156-ecd1-4495-9b07-9490eeea6875 req-0ca42748-11bf-4dc5-8b61-b23160f38076 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:21.599830 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5b479156-ecd1-4495-9b07-9490eeea6875 req-0ca42748-11bf-4dc5-8b61-b23160f38076 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:21.619777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-5b479156-ecd1-4495-9b07-9490eeea6875 req-0ca42748-11bf-4dc5-8b61-b23160f38076 service nova] Creating event network-changed:2b3c6bf7-5440-484c-8f3a-9e8036e84e6b for instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 on hv-cinder-85919 Oct 04 10:45:21.628453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-5b479156-ecd1-4495-9b07-9490eeea6875 req-0ca42748-11bf-4dc5-8b61-b23160f38076 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047508 Oct 04 10:45:21.630165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 509/1000] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:45:24.552231 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-404843891"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:45:24.552892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:24.560027 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:24.560510 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:24.560966 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:24.561650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:24.562211 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:24.562656 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:24.697316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.network.security_group_api [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Adding security group 02f1362d-0ed2-48c9-a4dc-d86b9193a6de to port 2b3c6bf7-5440-484c-8f3a-9e8036e84e6b Oct 04 10:45:25.105292 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e79f89f6-3ce6-4745-ace4-81f1577cc467 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/action" status: 202 len: 0 microversion: 2.1 time: 0.556427 Oct 04 10:45:25.110231 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 492/1001] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:45:24 2022] POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:45:25.122111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-5d45dd97-4fd1-41cd-b995-12a14843cf02 req-508d1d2c-5751-4888-af5e-15c32a2ab229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d52b483-a3e5-48e0-94cd-550a8ccf8050", "tag": "2b3c6bf7-5440-484c-8f3a-9e8036e84e6b"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:45:25.134030 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:25.134985 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:25.141743 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:25.142758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:25.142758 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:25.143337 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:25.143793 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:25.144732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:25.153776 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5d45dd97-4fd1-41cd-b995-12a14843cf02 req-508d1d2c-5751-4888-af5e-15c32a2ab229 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:25.154255 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5d45dd97-4fd1-41cd-b995-12a14843cf02 req-508d1d2c-5751-4888-af5e-15c32a2ab229 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:25.154735 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-5d45dd97-4fd1-41cd-b995-12a14843cf02 req-508d1d2c-5751-4888-af5e-15c32a2ab229 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:25.167093 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-5d45dd97-4fd1-41cd-b995-12a14843cf02 req-508d1d2c-5751-4888-af5e-15c32a2ab229 service nova] Creating event network-changed:2b3c6bf7-5440-484c-8f3a-9e8036e84e6b for instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 on hv-cinder-85919 Oct 04 10:45:25.172523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-5d45dd97-4fd1-41cd-b995-12a14843cf02 req-508d1d2c-5751-4888-af5e-15c32a2ab229 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060324 Oct 04 10:45:25.173741 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 510/1002] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:45:25.319359 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:25.328582 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b3fdc090-f737-43f1-9454-5f4bd89fb7e7 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1759 microversion: 2.1 time: 0.212796 Oct 04 10:45:25.329547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 493/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:25 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1759 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:50.734409 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=4 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:50.738897 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:45:50.741262 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:50.751431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:50.751431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:50.751431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:50.751431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:50.751832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:50.751832 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:50.974223 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d5a6c65e-9dd2-48d3-8db4-31382b105809 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/action" status: 202 len: 0 microversion: 2.1 time: 0.240935 Oct 04 10:45:50.974798 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 511/1004] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:45:50 2022] POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:45:50.983107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:50.983828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:50.986173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:50.986815 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=16 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:50.991804 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:50.992278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:50.992709 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:50.993436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:50.993882 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:50.994304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:51.146227 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:51.155157 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-33431de4-a984-4d10-83f1-10bb6beaad96 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1751 microversion: 2.1 time: 0.176082 Oct 04 10:45:51.155728 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 494/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:50 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:52.179352 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:52.180090 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:52.186785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:52.187965 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:52.188449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:52.189199 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:52.189664 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:52.190135 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:52.334153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:52.343473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c2dbfe81-60b2-4dfc-b13e-14205db39e01 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.168509 Oct 04 10:45:52.344048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 512/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:52 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:53.367158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:53.367764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:53.374276 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:53.374754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:53.375198 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:53.375874 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:53.376328 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:53.376752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:53.516109 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:53.525346 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-07c83bce-8faa-483d-816b-9e9869a81da5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.162262 Oct 04 10:45:53.525901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 495/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:53 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:54.548951 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:54.549570 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:54.556781 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:54.557321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:54.557758 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:54.558490 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:54.558941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:54.559371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:54.711886 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:54.720882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-cf14dc03-1621-4919-bb25-63a40985b992 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.175751 Oct 04 10:45:54.721460 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 513/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:54 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:55.745437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:55.746041 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:55.752384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:55.752877 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:55.753316 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:55.753992 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:55.754434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:55.754848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:55.894357 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:55.902850 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-df00dfd6-61c4-4d42-b64f-ca1c2ceaa830 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.161899 Oct 04 10:45:55.903406 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 496/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:55 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:56.925906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:56.926446 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:56.933407 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:56.943161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:56.943161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:56.943161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:56.943161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:56.943623 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:57.074955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:57.083091 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-6cbf3d70-134b-4e5a-9216-69a54a5a06a5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.161138 Oct 04 10:45:57.083656 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 514/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:56 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:58.107328 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:58.107935 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:58.114300 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:58.114773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:58.115200 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:58.115880 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:58.116426 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:58.116923 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:58.259421 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:58.267633 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7ad4244c-f6cf-4a37-8e75-1ec93f2ce05c tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.164104 Oct 04 10:45:58.268195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 497/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:58 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:45:59.291625 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:45:59.292297 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:45:59.298585 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:59.299059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:59.299488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:59.300164 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:45:59.300608 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:45:59.301062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:45:59.441209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:45:59.450020 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-de9dac79-3da8-4ac4-ad69-6e66390594b5 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.162881 Oct 04 10:45:59.450594 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 515/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:45:59 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:00.474620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:00.475278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:00.482253 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:00.482748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:00.483161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:00.483840 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:00.484289 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:00.484706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:00.626766 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:00.635362 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e1f65da3-3ac1-4653-9013-24f39fbc02fc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.164561 Oct 04 10:46:00.635910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 498/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:00 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:01.658417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:01.659051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:01.666309 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:01.666878 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:01.667338 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:01.668018 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:01.668464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:01.668905 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:01.811697 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:01.817055 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-eeabaf39-14fc-4bf0-8ecd-b44c6d3d0911 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.162428 Oct 04 10:46:01.817743 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 516/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:01 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:02.841554 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:02.842171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:02.848742 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:02.849259 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:02.849702 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:02.850417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:02.850876 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:02.851495 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:03.004921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:03.013669 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-735c7b2e-248d-4c80-8375-6baea3b1a67a tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.176303 Oct 04 10:46:03.014269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 499/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:02 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:04.036961 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:04.037554 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:04.044532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:04.045049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:04.045483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:04.046161 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:04.046601 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:04.047017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:04.191683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:04.200448 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-2855f22a-c104-4d52-861b-87849fff9931 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.167274 Oct 04 10:46:04.201045 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 517/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:04 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:05.223998 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:05.224894 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:05.231432 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:05.231908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:05.232338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:05.233057 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:05.233505 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:05.233923 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:05.378016 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:05.386750 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ef020855-57c0-4e6b-b287-fcd1afb0a523 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.166618 Oct 04 10:46:05.387308 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 500/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:05 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:06.415124 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:06.415963 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:06.423844 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:06.424327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:06.424764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:06.425688 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:06.426136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:06.426556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:06.577235 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:06.585359 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-84bb6de4-1276-48b7-8d5b-a74f4bcc73ae tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.177699 Oct 04 10:46:06.587060 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 518/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:06 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:07.610676 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:07.611215 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:07.617327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:07.617904 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:07.618345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:07.619116 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:07.619575 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:07.620052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:07.766164 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:07.775498 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b00748ae-d3c2-49b4-a128-4f4acb2270ec tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1756 microversion: 2.1 time: 0.169028 Oct 04 10:46:07.776062 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 501/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:07 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:08.798792 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:08.799400 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:08.806282 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:08.806758 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:08.807196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:08.807878 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:08.808326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:08.808748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:08.949040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:08.957396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-61dcbad2-614f-4396-9830-363e15c5f0cd tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1759 microversion: 2.1 time: 0.162458 Oct 04 10:46:08.957954 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 519/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:08 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:41.654429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-404843891"}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:46:41.654998 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:41.657181 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=16 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:41.657821 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=48 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:41.662465 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:41.662938 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:41.663370 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:41.664055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:41.664494 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:41.664931 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:41.791781 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.network.security_group_api [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Removing security group 02f1362d-0ed2-48c9-a4dc-d86b9193a6de from port 2b3c6bf7-5440-484c-8f3a-9e8036e84e6b Oct 04 10:46:42.159603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bf45caec-54cc-4c6e-b088-465937db1dd4 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/action" status: 202 len: 0 microversion: 2.1 time: 0.509584 Oct 04 10:46:42.160353 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 502/1021] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:46:41 2022] POST /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:46:42.168457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-ef4c5890-bc47-42e8-bd09-e4b4b18bc0db req-a18401a0-a242-45df-8745-8bcdbf1c6d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d52b483-a3e5-48e0-94cd-550a8ccf8050", "tag": "2b3c6bf7-5440-484c-8f3a-9e8036e84e6b"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:46:42.173746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=18 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:42.174457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:42.179702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ef4c5890-bc47-42e8-bd09-e4b4b18bc0db req-a18401a0-a242-45df-8745-8bcdbf1c6d59 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:42.181138 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ef4c5890-bc47-42e8-bd09-e4b4b18bc0db req-a18401a0-a242-45df-8745-8bcdbf1c6d59 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:42.181138 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ef4c5890-bc47-42e8-bd09-e4b4b18bc0db req-a18401a0-a242-45df-8745-8bcdbf1c6d59 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:42.193567 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-ef4c5890-bc47-42e8-bd09-e4b4b18bc0db req-a18401a0-a242-45df-8745-8bcdbf1c6d59 service nova] Creating event network-changed:2b3c6bf7-5440-484c-8f3a-9e8036e84e6b for instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 on hv-cinder-85919 Oct 04 10:46:42.199129 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-ef4c5890-bc47-42e8-bd09-e4b4b18bc0db req-a18401a0-a242-45df-8745-8bcdbf1c6d59 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Oct 04 10:46:42.200007 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 520/1022] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:46:43.456803 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:43.457723 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:43.464756 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:43.465287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:43.465732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:43.466441 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:43.466898 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:43.467321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:43.554016 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lazy-loading 'services' on Instance uuid 5d52b483-a3e5-48e0-94cd-550a8ccf8050 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:46:43.757809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-63b1a24e-6005-4cd9-b638-afb61c1595a8 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments/bcd790e9-1894-425a-8027-e6af7c655410" status: 202 len: 0 microversion: 2.1 time: 0.307382 Oct 04 10:46:43.758399 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 503/1023] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:46:43 2022] DELETE /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments/bcd790e9-1894-425a-8027-e6af7c655410 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:46:43.765277 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 10:46:43.765805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Tue Oct 4 10:46:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments (ip 10.222.0.42) !!! Oct 04 10:46:43.778792 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:43.781108 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:43.789699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:43.790821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:43.790821 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:43.791267 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:43.791711 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:43.792196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:43.822576 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-33f66ce7-a337-47bd-aaa7-aaea3c1ff9ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059010 Oct 04 10:46:43.823141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 521/1024] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:46:43 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:46:44.215504 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-f3f957d3-866e-43d6-8aaa-dbecebdb200a req-7817151a-8394-4099-8365-4dfd1f88848e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d52b483-a3e5-48e0-94cd-550a8ccf8050", "tag": "2b3c6bf7-5440-484c-8f3a-9e8036e84e6b"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:46:44.225911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f3f957d3-866e-43d6-8aaa-dbecebdb200a req-7817151a-8394-4099-8365-4dfd1f88848e service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:44.226455 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f3f957d3-866e-43d6-8aaa-dbecebdb200a req-7817151a-8394-4099-8365-4dfd1f88848e service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:44.227013 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f3f957d3-866e-43d6-8aaa-dbecebdb200a req-7817151a-8394-4099-8365-4dfd1f88848e service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:44.239478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-f3f957d3-866e-43d6-8aaa-dbecebdb200a req-7817151a-8394-4099-8365-4dfd1f88848e service nova] Creating event network-changed:2b3c6bf7-5440-484c-8f3a-9e8036e84e6b for instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 on hv-cinder-85919 Oct 04 10:46:44.244775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-f3f957d3-866e-43d6-8aaa-dbecebdb200a req-7817151a-8394-4099-8365-4dfd1f88848e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033936 Oct 04 10:46:44.246133 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 504/1025] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:46:44.835678 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:44.837831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:44.845255 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:44.845740 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:44.846183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:44.846869 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:44.847424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:44.847852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:44.877196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-572246ce-35ec-4d37-967d-babaf9ec97ee tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Oct 04 10:46:44.877757 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 522/1026] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:46:44 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:46:45.890775 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:45.893095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:45.899624 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:45.900104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:45.900539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:45.901256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:45.902424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:45.902848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:45.930202 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ced2c311-075c-406d-9f5b-89a0c612b03b tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044345 Oct 04 10:46:45.930749 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 505/1027] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 10:46:45 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:46:45.941416 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:45.941922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:45.949367 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:45.949850 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:45.950285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:45.950976 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:45.951424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:45.951848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:46.027334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] HTTP exception thrown: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 is not attached to volume bcd790e9-1894-425a-8027-e6af7c655410 Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Request method failure captured: Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: DELETE /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments/bcd790e9-1894-425a-8027-e6af7c655410 HTTP/1.1 Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA6G2yWyGEnPrSvV5QR5yXKqPSabbsPMFsekssp1GvyE33hQ05tDSklZbhDpCbs90_Li8kF9z4beJnLK-ihvW295pLvsRXXB6KQ5wRaRisaWSyrkqdw4lDWdQzHvSKe1wWDaO9_Tkcd4Mi--ngHK_d41IOxF1Hc_CmOpPjLyafmn75g Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 9171bd2ad8cc4736bb8c585f40040795 Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-TestMinimumBasicScenario-1384045374 Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:46:46.037651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9171bd2ad8cc4736bb8c585f40040795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9171bd2ad8cc4736bb8c585f40040795", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9171bd2ad8cc4736bb8c585f40040795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9171bd2ad8cc4736bb8c585f40040795"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-TestMinimumBasicScenario-1384045374 Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 9171bd2ad8cc4736bb8c585f40040795 Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1384045374 Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-TestMinimumBasicScenario-1384045374-project Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: f5073f864387435281b00e532bf236d0 Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-TestMinimumBasicScenario-1384045374-project Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:46:46.039379 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 is not attached to volume bcd790e9-1894-425a-8027-e6af7c655410 Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'server_id': '5d52b483-a3e5-48e0-94cd-550a8ccf8050', 'id': 'bcd790e9-1894-425a-8027-e6af7c655410'} Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bcd790e9-1894-425a-8027-e6af7c655410. Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:46:46.040320 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 is not attached to volume bcd790e9-1894-425a-8027-e6af7c655410 Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 is not attached to volume bcd790e9-1894-425a-8027-e6af7c655410 Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:46:46.042023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Returning 404 to user: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 is not attached to volume bcd790e9-1894-425a-8027-e6af7c655410 {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:46:46.043269 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b326a573-c036-4c81-97dc-40b53efcd437 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments/bcd790e9-1894-425a-8027-e6af7c655410" status: 404 len: 154 microversion: 2.1 time: 0.101627 Oct 04 10:46:46.043269 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 523/1028] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 10:46:45 2022] DELETE /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050/os-volume_attachments/bcd790e9-1894-425a-8027-e6af7c655410 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:46:47.324908 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:47.325418 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:47.331736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:47.332216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:47.332649 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:47.333364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:47.333818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:47.334243 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:47.358833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:46:47.609281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-867224cf-aa5e-4ea4-a984-05d3c4fad9f3 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 204 len: 0 microversion: 2.1 time: 0.287815 Oct 04 10:46:47.610087 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 506/1029] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:46:47 2022] DELETE /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:46:47.622028 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:47.622028 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:47.625396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:47.625898 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:47.626331 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:47.627022 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:47.627472 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:47.627957 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:47.766185 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:47.773264 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c3454450-c65c-4789-9d1f-bac5e65404cf tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1554 microversion: 2.1 time: 0.159027 Oct 04 10:46:47.776946 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 524/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:47 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:48.799046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:48.799779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:48.806278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:48.806786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:48.807258 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:48.808828 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:48.809308 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:48.809729 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:48.942485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:48.950128 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c73e4978-68fa-4b82-a43a-ca8d04326bfa tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1554 microversion: 2.1 time: 0.155327 Oct 04 10:46:48.950685 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 507/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:48 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:49.975653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:49.976260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:49.982663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:49.983162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:49.983606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:49.984316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:49.984771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:49.985234 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:50.080455 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:50.088448 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-09cade32-8b07-482c-b524-5ed64448a1e1 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1512 microversion: 2.1 time: 0.118190 Oct 04 10:46:50.089257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 525/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:49 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1512 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:50.186425 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-bd7b3027-80e7-4d4e-b549-236204c0d968 req-6979a439-f065-454a-be6f-bd321df7f054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d52b483-a3e5-48e0-94cd-550a8ccf8050", "name": "network-vif-deleted", "tag": "2b3c6bf7-5440-484c-8f3a-9e8036e84e6b"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:46:50.195981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bd7b3027-80e7-4d4e-b549-236204c0d968 req-6979a439-f065-454a-be6f-bd321df7f054 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:50.199641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bd7b3027-80e7-4d4e-b549-236204c0d968 req-6979a439-f065-454a-be6f-bd321df7f054 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:50.199641 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bd7b3027-80e7-4d4e-b549-236204c0d968 req-6979a439-f065-454a-be6f-bd321df7f054 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:50.208095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-bd7b3027-80e7-4d4e-b549-236204c0d968 req-6979a439-f065-454a-be6f-bd321df7f054 service nova] Creating event network-vif-deleted:2b3c6bf7-5440-484c-8f3a-9e8036e84e6b for instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 on hv-cinder-85919 Oct 04 10:46:50.212934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-bd7b3027-80e7-4d4e-b549-236204c0d968 req-6979a439-f065-454a-be6f-bd321df7f054 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153525 Oct 04 10:46:50.213856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 508/1033] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:46:51.111273 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:51.111884 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:51.117787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:51.118198 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:51.118636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:51.119313 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:51.119762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:51.120187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:51.150305 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:51.150777 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:51.151213 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:51.151654 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lazy-loading 'fault' on Instance uuid 5d52b483-a3e5-48e0-94cd-550a8ccf8050 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:46:51.191112 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5073f864387435281b00e532bf236d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9171bd2ad8cc4736bb8c585f40040795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:51.198687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-82a172eb-e6f8-4dfb-a6b8-dccb0904ebdc tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 200 len: 1347 microversion: 2.1 time: 0.091464 Oct 04 10:46:51.199814 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 526/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:51 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 1347 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:51.322851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:46:51.323464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:51.331101 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:51.331587 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:51.332022 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:51.332717 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:51.333204 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:51.333629 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:51.356086 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lazy-loading 'flavor' on Instance uuid ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:46:51.653517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-25ad05cc-0e6d-48bb-b663-8af0db90eecb tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "POST /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5/action" status: 202 len: 0 microversion: 2.1 time: 0.334326 Oct 04 10:46:51.654224 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 509/1035] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:46:51 2022] POST /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:46:51.662312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:51.663310 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:51.669905 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:51.670388 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:51.670818 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:51.671508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:51.671952 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:51.672373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:51.802222 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:51.810550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9c9b698d-1372-4330-8eb7-27c1c299e428 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.152127 Oct 04 10:46:51.811108 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 527/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:51 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:52.223242 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:52.223946 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] [instance: 5d52b483-a3e5-48e0-94cd-550a8ccf8050] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:52.230183 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:52.230672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:52.231764 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:52.232442 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:52.232931 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:52.233364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:52.246521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] HTTP exception thrown: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 could not be found. Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Request method failure captured: Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 HTTP/1.1 Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA6G2yWyGEnPrSvV5QR5yXKqPSabbsPMFsekssp1GvyE33hQ05tDSklZbhDpCbs90_Li8kF9z4beJnLK-ihvW295pLvsRXXB6KQ5wRaRisaWSyrkqdw4lDWdQzHvSKe1wWDaO9_Tkcd4Mi--ngHK_d41IOxF1Hc_CmOpPjLyafmn75g Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 9171bd2ad8cc4736bb8c585f40040795 Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-TestMinimumBasicScenario-1384045374 Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:46:52.248173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9171bd2ad8cc4736bb8c585f40040795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9171bd2ad8cc4736bb8c585f40040795", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9171bd2ad8cc4736bb8c585f40040795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9171bd2ad8cc4736bb8c585f40040795"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-TestMinimumBasicScenario-1384045374 Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 9171bd2ad8cc4736bb8c585f40040795 Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1384045374 Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-TestMinimumBasicScenario-1384045374-project Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: f5073f864387435281b00e532bf236d0 Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-TestMinimumBasicScenario-1384045374-project Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 could not be found. Oct 04 10:46:52.249916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '5d52b483-a3e5-48e0-94cd-550a8ccf8050'} Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 could not be found. Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:46:52.250866 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 could not be found. Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 could not be found. Oct 04 10:46:52.252547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:46:52.254122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Returning 404 to user: Instance 5d52b483-a3e5-48e0-94cd-550a8ccf8050 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:46:52.254122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-026d1d4d-3f4e-4849-b5f8-0de01818b267 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050" status: 404 len: 111 microversion: 2.1 time: 0.030874 Oct 04 10:46:52.254122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 510/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:52 2022] GET /compute/v2.1/servers/5d52b483-a3e5-48e0-94cd-550a8ccf8050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:46:52.260120 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e18a2df1-f7e6-4993-9dd0-967534fc9356 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] Calling method '.version_select at 0x7f9be94ffdc0>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:52.350915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e18a2df1-f7e6-4993-9dd0-967534fc9356 tempest-TestMinimumBasicScenario-1384045374 tempest-TestMinimumBasicScenario-1384045374-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-641609002" status: 202 len: 0 microversion: 2.1 time: 0.094709 Oct 04 10:46:52.351497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 528/1038] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 10:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-641609002 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:46:52.833377 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:52.834023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:52.840787 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:52.841315 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:52.841751 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:52.842440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:52.842883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:52.843303 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:52.986584 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:52.995291 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-32e719a6-6744-4cee-b341-452a9cc5fbe5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.165704 Oct 04 10:46:52.995931 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 511/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:52 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:54.021009 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:54.022105 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:54.031595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:54.032218 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:54.032663 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:54.033419 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:54.034001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:54.034791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:54.169584 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:54.177512 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d35f435e-792d-4a56-bd52-bcd73fc9b7b0 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.161434 Oct 04 10:46:54.178089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 529/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:54 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:55.201402 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:55.202008 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:55.208542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:55.209335 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:55.210010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:55.210810 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:55.211342 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:55.211986 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:55.399960 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:55.407890 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bf0f7db2-434e-4544-9cce-4beea7251138 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.211174 Oct 04 10:46:55.408460 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 512/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:55 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:56.432314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:56.433096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:56.439900 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:56.440631 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:56.441149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:56.441863 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:56.442312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:56.442730 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:56.593473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:56.601927 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-39e979d3-97f3-41d3-b65a-f6fc1f02bb07 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.174140 Oct 04 10:46:56.602500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 530/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:56 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:57.626124 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:57.626732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:57.634252 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:57.634769 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:57.635213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:57.635919 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:57.636372 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:57.637542 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:57.773278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:57.781531 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-87b30c6e-96cc-4ae1-ab9e-df2492b08ee5 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.159919 Oct 04 10:46:57.782103 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 513/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:57 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:46:58.805809 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:46:58.806410 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:46:58.814464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:58.814937 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:58.815368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:58.816059 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:46:58.816492 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:46:58.816929 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:46:59.270406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:46:59.278125 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-743fa430-9be0-4404-af03-311e3cc8fb9d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.476097 Oct 04 10:46:59.278690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 531/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:46:58 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:00.302247 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:00.302871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:00.311055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:00.311543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:00.311986 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:00.312680 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:00.313168 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:00.313608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:00.447972 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:00.457110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-4f658cd4-4271-4752-ae91-681f34a47de9 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.158697 Oct 04 10:47:00.457861 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 514/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:00 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:01.480401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:01.481149 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:01.487651 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:01.488139 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:01.488577 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:01.489302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:01.489785 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:01.495033 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:01.628041 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:01.636029 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-ed3de8ee-4f19-4489-a75d-c2328aebbe2d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.159441 Oct 04 10:47:01.636603 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 532/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:01 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:02.660216 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:02.660830 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:02.667343 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:02.667826 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:02.669000 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:02.669700 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:02.670149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:02.670570 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:02.809242 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:02.817023 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f7e84f23-6948-4dae-b2fb-b450613cfd23 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.160646 Oct 04 10:47:02.817821 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 515/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:02 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:03.842311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:03.843752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:03.850537 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:03.851052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:03.851496 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:03.852244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:03.852703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:03.853162 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:03.992133 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:04.000875 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-180e3d44-fe1e-481f-b67c-f00bab38314b tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.162821 Oct 04 10:47:04.001462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 533/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:03 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:47:05.025655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:05.026256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:05.034383 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:05.035638 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:05.035638 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:05.036159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:05.036816 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:05.037273 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:05.056746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:05.173066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:05.180678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-11edd9f2-bd2b-460e-9058-42a99044729c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1568 microversion: 2.1 time: 0.159073 Oct 04 10:47:05.181282 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 516/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:05 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:05.203879 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:05.204482 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:05.211102 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:05.211583 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:05.212020 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:05.212703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:05.213457 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:05.213924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:05.309726 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127628) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 10:47:05.809380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8847ec94-4e50-456c-804f-1373a355e275 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "POST /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5/action" status: 202 len: 0 microversion: 2.1 time: 0.609813 Oct 04 10:47:05.811036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 534/1050] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 10:47:05 2022] POST /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:47:05.818661 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:05.819279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:05.837186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:05.837678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:05.838112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:05.839727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:05.840220 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:05.840650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:05.987261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:06.004412 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-649ae2fd-3b02-4397-a242-5de7dc5c2535 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1516 microversion: 2.1 time: 0.188591 Oct 04 10:47:06.005321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 517/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:05 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:07.027773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:07.028312 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:07.035031 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:07.035615 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:07.035965 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:07.040187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:07.040187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:07.040187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:07.316826 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:07.330270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-56e48e33-a0e8-47e9-ae81-2af9929a5a75 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1516 microversion: 2.1 time: 0.306364 Oct 04 10:47:07.345050 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 535/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:07 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1516 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:07.417296 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-bdb43516-dbb9-4dab-a433-a460bcda4ab7 req-fdc11378-7762-43fc-9ead-09b61c6a6c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5", "name": "network-vif-unplugged", "status": "completed", "tag": "375f7f2c-8a5a-4508-b0d8-f75bb0712701"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:07.428630 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bdb43516-dbb9-4dab-a433-a460bcda4ab7 req-fdc11378-7762-43fc-9ead-09b61c6a6c41 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:07.429136 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bdb43516-dbb9-4dab-a433-a460bcda4ab7 req-fdc11378-7762-43fc-9ead-09b61c6a6c41 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:07.432577 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bdb43516-dbb9-4dab-a433-a460bcda4ab7 req-fdc11378-7762-43fc-9ead-09b61c6a6c41 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:07.446529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.compute.server_external_events [req-bdb43516-dbb9-4dab-a433-a460bcda4ab7 req-fdc11378-7762-43fc-9ead-09b61c6a6c41 service nova] Unable to find a host for instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5. Dropping event network-vif-unplugged {{(pid=127627) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 10:47:07.447683 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-bdb43516-dbb9-4dab-a433-a460bcda4ab7 req-fdc11378-7762-43fc-9ead-09b61c6a6c41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.240017 Oct 04 10:47:07.448794 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 518/1053] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 242 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 10:47:08.356075 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:08.356962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:08.367115 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:08.367600 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:08.368238 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:08.369227 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:08.370023 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:08.370828 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:08.532578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:08.542406 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:08.545002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-500a1817-3787-4347-ab8a-f49a0efe9051 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1516 microversion: 2.1 time: 0.194725 Oct 04 10:47:08.546701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 536/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:08 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:09.570100 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:09.571380 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:09.578836 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:09.579463 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:09.580091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:09.580822 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:09.581304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:09.581732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:09.739267 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:09.747319 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-108aa6b5-221f-4bd8-a15c-d8f607d1602c tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1516 microversion: 2.1 time: 0.181167 Oct 04 10:47:09.748773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 519/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:09 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:47:10.771236 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:10.771956 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:10.778925 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:10.779474 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:10.779997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:10.780691 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:10.781170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:10.781595 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:10.922086 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:10.929831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9af82952-8972-4cd5-bcb1-88d99f1e9651 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1518 microversion: 2.1 time: 0.162911 Oct 04 10:47:10.930392 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 537/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:10 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:11.954120 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:11.954728 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:11.957055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:11.974565 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:11.975052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:11.975485 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:11.976186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:11.976631 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:11.977078 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:12.131033 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:12.138733 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ee9e2df6-4790-4cfd-aec0-4e6f6eb579b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1518 microversion: 2.1 time: 0.188363 Oct 04 10:47:12.139307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 520/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:11 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:13.162826 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:13.163597 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:13.171533 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:13.172254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:13.172917 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:13.173791 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:13.174414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:13.175047 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:13.821136 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:13.830321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3e4551a7-0290-4c88-b47c-6d3824b0ffaa tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.672098 Oct 04 10:47:13.835101 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 538/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:13 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:14.860906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:14.861773 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:14.876493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:14.876818 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:14.882627 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:14.883387 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:14.884921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:14.885539 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:15.030633 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:15.044024 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8499703e-1531-4cea-816e-c1d9e3ad126f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.189628 Oct 04 10:47:15.045939 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 521/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:14 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:16.068890 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:16.079326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:16.079326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:16.079326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:16.079326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:16.079326 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:16.079828 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:16.079957 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:16.080388 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:16.219153 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:16.226867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c82a6947-7a3a-40de-afd9-ec6e378786d6 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.162016 Oct 04 10:47:16.227647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 539/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:16 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:17.251694 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:17.252994 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:17.259427 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:17.259925 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:17.260366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:17.261135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:17.261594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:17.262025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:17.642873 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9e0fc78f-0da7-4a65-9fbb-ecddf97b99d4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Action: 'create', calling method: .version_select at 0x7f9be94e1f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2005908445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaMB8qVuIw9w7vjSojYFC6WNlvVB0/Xe2LchY2oG1wP4kpkF9o3tEUkhRzE2VqGpP+6BVS0kYAyg4A67TDjpX1li8fUq/zT6frkisdBytWT27sEaiC122G6vJvxCvKeuA=="}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:17.659988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-9e0fc78f-0da7-4a65-9fbb-ecddf97b99d4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:47:17.664049 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-9e0fc78f-0da7-4a65-9fbb-ecddf97b99d4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for user 807807d370a94aa6a312e51c7a8a2db2 and project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'key_pairs'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:47:17.748393 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:17.756752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-92ab4148-4ba8-48de-9aad-2c6ef1f99629 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.509620 Oct 04 10:47:17.757379 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 522/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:17 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:17.791144 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9e0fc78f-0da7-4a65-9fbb-ecddf97b99d4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.376542 Oct 04 10:47:17.791769 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 540/1062] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 10:47:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:47:18.780277 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:18.780917 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:18.790529 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:18.791323 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:18.792440 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:18.794371 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:18.795037 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:18.796288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:18.965396 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:18.973644 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c5b510e4-7711-44e0-96fe-69c10fe675f7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.197923 Oct 04 10:47:18.974222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 523/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:18 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:19.998441 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:19.999066 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:20.006242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:20.006735 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:20.007180 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:20.007879 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:20.008334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:20.008760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:20.195258 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:20.209160 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-72756dc2-4374-4e31-8eee-959fbd14094f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.215594 Oct 04 10:47:20.210002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 541/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:19 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:21.234307 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:21.234920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:21.241947 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:21.242436 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:21.242868 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:21.243608 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:21.244060 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:21.244480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:21.376214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:21.384053 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-2f4880ed-f907-4970-a6e5-c683aedf60c7 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.154523 Oct 04 10:47:21.384603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 524/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:21 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:22.407225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:22.407825 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:22.414232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:22.414724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:22.415138 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:22.415816 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:22.416262 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:22.417694 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:22.563708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:22.571505 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-50aabac8-a8cd-4793-a5ab-57d77980b5b8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.168296 Oct 04 10:47:22.572084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 542/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:22 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:23.280659 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-8d5ba52b-a930-43c7-ba4d-3407defa9020 req-1fefd237-7473-464b-87a1-2b2ee0a7d421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5", "name": "network-vif-plugged", "status": "completed", "tag": "375f7f2c-8a5a-4508-b0d8-f75bb0712701"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:23.292344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8d5ba52b-a930-43c7-ba4d-3407defa9020 req-1fefd237-7473-464b-87a1-2b2ee0a7d421 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:23.293034 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8d5ba52b-a930-43c7-ba4d-3407defa9020 req-1fefd237-7473-464b-87a1-2b2ee0a7d421 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:23.298055 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-8d5ba52b-a930-43c7-ba4d-3407defa9020 req-1fefd237-7473-464b-87a1-2b2ee0a7d421 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:23.304407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-8d5ba52b-a930-43c7-ba4d-3407defa9020 req-1fefd237-7473-464b-87a1-2b2ee0a7d421 service nova] Creating event network-vif-plugged:375f7f2c-8a5a-4508-b0d8-f75bb0712701 for instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 on hv-cinder-85919 Oct 04 10:47:23.310269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-8d5ba52b-a930-43c7-ba4d-3407defa9020 req-1fefd237-7473-464b-87a1-2b2ee0a7d421 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032640 Oct 04 10:47:23.312571 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 525/1067] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:47:23.598302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:23.599924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:23.608588 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:23.609262 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:23.611440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:23.611440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:23.611440 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:23.612203 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:23.816209 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:23.823934 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fe2e40db-b1f4-4f46-895c-e5f7fb1a0e43 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.230860 Oct 04 10:47:23.824487 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 543/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:23 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:24.849331 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:24.850043 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:24.856063 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:24.857321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:24.857774 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:24.858508 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:24.859157 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:24.859594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:25.008755 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:25.017278 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8d9049ff-95a2-47f9-9080-95910d55c3c2 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1574 microversion: 2.1 time: 0.173055 Oct 04 10:47:25.017841 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 526/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:24 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:26.041300 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:26.041902 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:26.049560 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:26.050060 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:26.050498 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:26.051357 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:26.051661 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:26.052098 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:26.191169 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:26.198863 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-72fdc267-78ee-48b9-83de-1ff86e901ded tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1561 microversion: 2.1 time: 0.161706 Oct 04 10:47:26.199431 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 544/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:26 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:37.643700 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2024277437", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2005908445", "security_groups": [{"name": "tempest-secgroup-smoke-1630351900"}], "block_device_mapping_v2": [{"uuid": "07f28f82-4327-46a7-9ab0-9819b7f67a78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "67809253-d647-4a6b-b83d-01e173cc834a"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:37.653956 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 10:47:37.654110 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Tue Oct 4 10:47:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 04 10:47:37.655675 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=13 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:37.656564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=54 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:37.761474 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] validate_networks() for [('67809253-d647-4a6b-b83d-01e173cc834a', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:47:38.147429 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:47:38.147845 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:47:38.148330 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:47:38.148741 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:47:38.149177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:47:38.157860 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:38.158333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:38.158757 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:38.159468 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:38.159912 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:38.160328 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:38.176522 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:47:38.180414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for user 807807d370a94aa6a312e51c7a8a2db2 and project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:47:38.236001 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:47:38.238119 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07f28f82-4327-46a7-9ab0-9819b7f67a78',volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:47:38.661246 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0ac1ea4c-4503-4b5f-bee8-9d31f0c70dfa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.021368 Oct 04 10:47:38.667693 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 527/1071] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:47:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:47:38.673646 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-214aeef8-ddec-4577-a5c5-87dbd226aed3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:38.674267 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-214aeef8-ddec-4577-a5c5-87dbd226aed3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:38.676586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=4 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:38.677719 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:38.678404 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=42 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:38.730001 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-214aeef8-ddec-4577-a5c5-87dbd226aed3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:38.738030 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-214aeef8-ddec-4577-a5c5-87dbd226aed3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1095 microversion: 2.1 time: 0.069085 Oct 04 10:47:38.738762 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 545/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:38 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:39.761528 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-a77c8315-4f6b-4e72-851d-d811b0ad2bc0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:39.762171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-a77c8315-4f6b-4e72-851d-d811b0ad2bc0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:39.814703 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-a77c8315-4f6b-4e72-851d-d811b0ad2bc0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:39.821658 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-a77c8315-4f6b-4e72-851d-d811b0ad2bc0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1095 microversion: 2.1 time: 0.064564 Oct 04 10:47:39.822222 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 528/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:39 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:40.846550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:40.847128 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:40.853828 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:40.854306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:40.854740 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:40.855423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:40.855873 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:40.856292 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:40.920017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:40.928926 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8e27840e-ea76-45ef-a7fa-6db274e45b96 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1193 microversion: 2.1 time: 0.087787 Oct 04 10:47:40.929569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 546/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:40 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:41.953799 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:41.954772 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:41.962328 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:41.962856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:41.963275 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:41.964235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:41.964805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:41.972135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:42.108178 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:42.117086 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-49662abd-d5d3-45a4-9cea-d89f61568536 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1279 microversion: 2.1 time: 0.167906 Oct 04 10:47:42.117983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 529/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:41 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:42.933611 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-151e90b7-6764-49ac-816a-f1ae5cbc94b1 req-45a3914c-bc8a-481e-8f57-7ed061216c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a406a0-b453-4620-be3f-715c35059736", "tag": "8b900ed3-ed54-448d-8baf-8c7dfec25c7e"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:42.943878 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-151e90b7-6764-49ac-816a-f1ae5cbc94b1 req-45a3914c-bc8a-481e-8f57-7ed061216c2d service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:42.949077 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-151e90b7-6764-49ac-816a-f1ae5cbc94b1 req-45a3914c-bc8a-481e-8f57-7ed061216c2d service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:42.949077 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-151e90b7-6764-49ac-816a-f1ae5cbc94b1 req-45a3914c-bc8a-481e-8f57-7ed061216c2d service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:42.956987 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-151e90b7-6764-49ac-816a-f1ae5cbc94b1 req-45a3914c-bc8a-481e-8f57-7ed061216c2d service nova] Creating event network-changed:8b900ed3-ed54-448d-8baf-8c7dfec25c7e for instance 23a406a0-b453-4620-be3f-715c35059736 on hv-cinder-85919 Oct 04 10:47:42.961964 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-151e90b7-6764-49ac-816a-f1ae5cbc94b1 req-45a3914c-bc8a-481e-8f57-7ed061216c2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032145 Oct 04 10:47:42.962558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 547/1076] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:47:43.140772 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:43.141385 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:43.147754 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:43.148231 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:43.148665 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:43.149376 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:43.149831 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:43.150250 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:43.288317 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:43.295955 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7cb760e6-f9b4-42d7-b1e3-1893e9709107 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.159047 Oct 04 10:47:43.297164 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 530/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:43 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:44.321642 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:44.322337 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:44.329265 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:44.329750 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:44.330181 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:44.330936 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:44.331382 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:44.331807 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:44.558853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:44.569497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-11bda4a8-378c-4e02-b241-77d2a07dfc98 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.251270 Oct 04 10:47:44.569497 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 548/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:44 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:45.591875 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:45.592480 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:45.599476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:45.599953 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:45.600421 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:45.601135 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:45.601586 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:45.602005 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:45.732568 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:45.740270 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-9eccc123-fa12-461c-a7fd-d0287846a6aa tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.152957 Oct 04 10:47:45.740832 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 531/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:45 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:46.763256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:46.763864 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:46.770593 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:46.771070 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:46.771503 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:46.772186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:46.772960 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:46.773082 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:46.907626 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:46.915208 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-f35e2183-dbc7-402e-ad20-6bd3c620487e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.155760 Oct 04 10:47:46.915773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 549/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:46 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:47.938531 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:47.939228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:47.945586 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:47.946072 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:47.946495 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:47.947173 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:47.947622 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:47.948042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:48.088117 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:48.096647 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-df8bf399-602d-491f-92d2-0759699aad5b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.162599 Oct 04 10:47:48.097226 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 532/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:47 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:49.118778 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:49.119414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:49.121870 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:49.127771 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:49.128254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:49.128690 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:49.129411 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:49.129865 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:49.130296 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:49.258131 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:49.265705 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b8f44bf9-6e3b-4514-98a1-ba77cb3da9ea tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.150777 Oct 04 10:47:49.266301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 550/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:49 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:50.288524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:50.289288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:50.291019 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:50.292221 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=8 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:50.296920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:50.303235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:50.303235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:50.303235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:50.303235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:50.303666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:50.438399 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:50.446083 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-603f15d9-ddfc-4b66-beaf-0dd722ef922a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.161379 Oct 04 10:47:50.446646 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 533/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:50 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:51.469186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:51.469988 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:51.476084 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:51.476570 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:51.477054 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:51.477748 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:51.478211 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:51.478642 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:51.611510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:51.619526 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-db6f6760-724a-446a-87db-3099d9401030 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.154220 Oct 04 10:47:51.620100 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 551/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:51 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:52.641816 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:52.642424 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:52.648915 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:52.649402 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:52.649837 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:52.650556 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:52.651007 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:52.651457 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:52.784199 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:52.791788 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6dde9a61-fb92-4329-9772-cd6ed4ed89a1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.153944 Oct 04 10:47:52.792349 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 534/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:52 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:53.581849 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-6089566a-e5a3-45c8-9c31-6cfc79fe7faf req-bd94a411-0395-4caa-b938-1a0d14389ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a406a0-b453-4620-be3f-715c35059736", "name": "network-vif-plugged", "status": "completed", "tag": "8b900ed3-ed54-448d-8baf-8c7dfec25c7e"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:53.592613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-6089566a-e5a3-45c8-9c31-6cfc79fe7faf req-bd94a411-0395-4caa-b938-1a0d14389ddf service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:53.593160 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-6089566a-e5a3-45c8-9c31-6cfc79fe7faf req-bd94a411-0395-4caa-b938-1a0d14389ddf service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:53.597096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-6089566a-e5a3-45c8-9c31-6cfc79fe7faf req-bd94a411-0395-4caa-b938-1a0d14389ddf service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:53.605242 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-6089566a-e5a3-45c8-9c31-6cfc79fe7faf req-bd94a411-0395-4caa-b938-1a0d14389ddf service nova] Creating event network-vif-plugged:8b900ed3-ed54-448d-8baf-8c7dfec25c7e for instance 23a406a0-b453-4620-be3f-715c35059736 on hv-cinder-85919 Oct 04 10:47:53.610257 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-6089566a-e5a3-45c8-9c31-6cfc79fe7faf req-bd94a411-0395-4caa-b938-1a0d14389ddf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032654 Oct 04 10:47:53.611361 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 552/1086] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:47:53.814713 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:53.815368 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:53.821871 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:53.822346 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:53.822777 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:53.823464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:53.823916 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:53.824336 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:53.959245 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:53.967235 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-18898c0a-ef0c-4654-ba11-509f883538c0 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.156444 Oct 04 10:47:53.967795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 535/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:53 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:54.991978 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:54.992721 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:54.998871 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:54.999353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:54.999787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:55.000478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:55.000963 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:55.001635 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:55.131997 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:55.139761 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-bc0506c8-6067-42bc-9ce3-4b1cede7bf60 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1267 microversion: 2.1 time: 0.152455 Oct 04 10:47:55.140327 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 553/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:54 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:56.163388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:56.164019 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:56.170462 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:56.170947 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:56.171384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:56.172068 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:56.172521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:56.172984 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:56.312569 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:56.320787 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-07bfd08e-4ff7-424b-b25c-0687912c0b97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1454 microversion: 2.1 time: 0.161266 Oct 04 10:47:56.321378 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 536/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:56 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:56.342569 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:47:56.343182 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:47:56.350170 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:56.350653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:56.351096 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:56.351784 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:56.352240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:56.352671 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:56.486890 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:47:56.494679 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-68ea5056-03f5-4542-ac1a-11526df606dc tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1454 microversion: 2.1 time: 0.156110 Oct 04 10:47:56.495239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 554/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:47:56 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:47:58.546392 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-e14dc489-fc20-4231-ac59-cdcc4c4eed50 req-98af7575-fe3c-40e4-9616-ff820796ca61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a406a0-b453-4620-be3f-715c35059736", "tag": "8b900ed3-ed54-448d-8baf-8c7dfec25c7e"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:47:58.557329 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-e14dc489-fc20-4231-ac59-cdcc4c4eed50 req-98af7575-fe3c-40e4-9616-ff820796ca61 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:47:58.557806 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-e14dc489-fc20-4231-ac59-cdcc4c4eed50 req-98af7575-fe3c-40e4-9616-ff820796ca61 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:47:58.558236 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-e14dc489-fc20-4231-ac59-cdcc4c4eed50 req-98af7575-fe3c-40e4-9616-ff820796ca61 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:47:58.569517 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-e14dc489-fc20-4231-ac59-cdcc4c4eed50 req-98af7575-fe3c-40e4-9616-ff820796ca61 service nova] Creating event network-changed:8b900ed3-ed54-448d-8baf-8c7dfec25c7e for instance 23a406a0-b453-4620-be3f-715c35059736 on hv-cinder-85919 Oct 04 10:47:58.574690 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-e14dc489-fc20-4231-ac59-cdcc4c4eed50 req-98af7575-fe3c-40e4-9616-ff820796ca61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031888 Oct 04 10:47:58.575388 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 537/1091] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:48:40.719371 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:40.719946 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:48:40.722491 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=22 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:48:40.723025 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:48:40.723462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=46 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:48:40.723922 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=52 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:48:40.728587 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-bdc13816-c555-4bdf-935c-90f0306d330c req-35e5761b-6a79-4c9f-a2a2-bbb983167a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5", "tag": "375f7f2c-8a5a-4508-b0d8-f75bb0712701"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:48:40.729372 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:40.730203 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:40.730874 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:40.731796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:40.732266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:40.732702 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:40.738193 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bdc13816-c555-4bdf-935c-90f0306d330c req-35e5761b-6a79-4c9f-a2a2-bbb983167a66 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:40.738666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bdc13816-c555-4bdf-935c-90f0306d330c req-35e5761b-6a79-4c9f-a2a2-bbb983167a66 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:40.739091 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-bdc13816-c555-4bdf-935c-90f0306d330c req-35e5761b-6a79-4c9f-a2a2-bbb983167a66 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:40.751149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-bdc13816-c555-4bdf-935c-90f0306d330c req-35e5761b-6a79-4c9f-a2a2-bbb983167a66 service nova] Creating event network-changed:375f7f2c-8a5a-4508-b0d8-f75bb0712701 for instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 on hv-cinder-85919 Oct 04 10:48:40.756647 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-bdc13816-c555-4bdf-935c-90f0306d330c req-35e5761b-6a79-4c9f-a2a2-bbb983167a66 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035344 Oct 04 10:48:40.757829 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 538/1092] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:48:40.760188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:48:41.059565 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-02bae4ad-de27-490e-b03a-75831258761e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 204 len: 0 microversion: 2.1 time: 0.343705 Oct 04 10:48:41.060178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 555/1093] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:48:40 2022] DELETE /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:48:41.069104 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:41.071920 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:48:41.079680 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:41.080568 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:41.081246 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:41.082140 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:41.082593 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:41.083014 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:41.220107 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:48:41.228589 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6ed1a61e-c2d5-4049-b967-70d3a7d0f6c8 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.163893 Oct 04 10:48:41.229186 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 539/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:48:41 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:48:42.252109 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:42.252817 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:48:42.259396 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:42.259886 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:42.260328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:42.261062 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:42.261529 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:42.261953 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:42.403853 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:48:42.411648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c1c41158-facd-4cd9-a01b-30cb8c7838fc tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1567 microversion: 2.1 time: 0.163880 Oct 04 10:48:42.412215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 556/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:48:42 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:48:43.354894 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-ee5c4655-954c-4ab3-94ed-2b54f41182cf req-3715bb81-2026-4c03-a21f-ca343e02fc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5", "name": "network-vif-deleted", "tag": "375f7f2c-8a5a-4508-b0d8-f75bb0712701"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:48:43.364461 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ee5c4655-954c-4ab3-94ed-2b54f41182cf req-3715bb81-2026-4c03-a21f-ca343e02fc70 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:43.367558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ee5c4655-954c-4ab3-94ed-2b54f41182cf req-3715bb81-2026-4c03-a21f-ca343e02fc70 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:43.367558 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-ee5c4655-954c-4ab3-94ed-2b54f41182cf req-3715bb81-2026-4c03-a21f-ca343e02fc70 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:43.376572 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-ee5c4655-954c-4ab3-94ed-2b54f41182cf req-3715bb81-2026-4c03-a21f-ca343e02fc70 service nova] Creating event network-vif-deleted:375f7f2c-8a5a-4508-b0d8-f75bb0712701 for instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 on hv-cinder-85919 Oct 04 10:48:43.381597 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-ee5c4655-954c-4ab3-94ed-2b54f41182cf req-3715bb81-2026-4c03-a21f-ca343e02fc70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030402 Oct 04 10:48:43.382784 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 540/1096] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:48:43.435980 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:43.436532 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:48:43.443063 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:43.443556 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:43.443999 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:43.445625 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:43.446106 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:43.446543 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:43.510323 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:48:43.518126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-175a029f-e289-4542-a7c2-8da1ee7b1b5e tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1382 microversion: 2.1 time: 0.086080 Oct 04 10:48:43.518705 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 557/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:48:43 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:48:44.542425 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:44.543132 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:48:44.550129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:44.550624 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:44.551062 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:44.551795 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:44.552279 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:44.552704 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:44.628647 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:44.629166 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:44.629646 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:44.630090 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lazy-loading 'fault' on Instance uuid ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:48:44.673184 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0202c683747c299c3ea857f72c3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ae1d33c9874be780d3d55c0d2fc784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:48:44.681547 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-cd5197aa-c0c4-48bd-8b3d-7108d2639a92 tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 200 len: 1224 microversion: 2.1 time: 0.143780 Oct 04 10:48:44.682105 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 541/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:48:44 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 1224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:48:45.704749 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:45.705397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] [instance: ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:48:45.712395 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:45.712890 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:45.713328 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:45.714266 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:45.714709 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:45.715126 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:45.728190 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] HTTP exception thrown: Instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 could not be found. Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Request method failure captured: Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 HTTP/1.1 Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA5mZ8JH94mFLJx51u4ni7QXGWlsDyiMoI9wUA0mnnZPE-yeAQ9v8qOlKb9rtSS3RAdUsY7EzahefHJcBfB18O-1iKypUEj6Gv2jTl7BreIDwGdNVFOE0ewGlepZlH3uYWvLw4Hthm-CtEX0gtLNXnQmxeJZ-ruiQexE_H0MeKzGtdo Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 49ae1d33c9874be780d3d55c0d2fc784 Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-TestShelveInstance-317875323 Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:48:45.729831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/49ae1d33c9874be780d3d55c0d2fc784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_49ae1d33c9874be780d3d55c0d2fc784", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/49ae1d33c9874be780d3d55c0d2fc784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/49ae1d33c9874be780d3d55c0d2fc784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-TestShelveInstance-317875323 Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 49ae1d33c9874be780d3d55c0d2fc784 Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-TestShelveInstance-317875323 Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-TestShelveInstance-317875323-project Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 18d0202c683747c299c3ea857f72c3f5 Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-TestShelveInstance-317875323-project Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 could not be found. Oct 04 10:48:45.731648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': 'ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5'} Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 could not be found. Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:48:45.732677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 could not be found. Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 could not be found. Oct 04 10:48:45.734437 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:48:45.736225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Returning 404 to user: Instance ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:48:45.736225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-175cc468-3658-41f7-8000-85b58386c11d tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5" status: 404 len: 111 microversion: 2.1 time: 0.030250 Oct 04 10:48:45.736225 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 558/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:48:45 2022] GET /compute/v2.1/servers/ecb40ede-4b71-4cd7-8ae0-58e9fcfff4e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:48:45.978763 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b7cd513a-50af-4fac-95b2-61c435d5a50f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] Calling method '.version_select at 0x7f9be9416430>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:46.069213 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b7cd513a-50af-4fac-95b2-61c435d5a50f tempest-TestShelveInstance-317875323 tempest-TestShelveInstance-317875323-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1348320412" status: 202 len: 0 microversion: 2.1 time: 0.094663 Oct 04 10:48:46.069718 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 542/1100] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Oct 4 10:48:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1348320412 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:49:52.725665 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a199f6ed-2119-48f1-a8b4-499e20ba22d9] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 10:49:52.726276 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:52.726921 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:52.727704 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 10:49:52.727839 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Tue Oct 4 10:49:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 (ip 10.222.0.42) !!! Oct 04 10:49:52.732215 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:52.732752 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:49:52.739981 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:52.740464 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:52.740934 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:52.741637 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:52.742092 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:52.742521 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:52.769622 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:49:53.081014 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-54e7cd32-56c8-47ef-aecb-c1f891ae9961 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 204 len: 0 microversion: 2.1 time: 0.357169 Oct 04 10:49:53.081593 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 559/1101] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:49:52 2022] DELETE /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:49:53.088223 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=18 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:53.089010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:53.094116 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:53.094731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:49:53.101552 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:53.102042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:53.102644 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:53.103490 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:53.104603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:53.105112 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:53.237177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:49:53.245479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-c0864fb3-2fdd-4132-a934-bab191b4f4c8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1578 microversion: 2.1 time: 0.159551 Oct 04 10:49:53.246095 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 543/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:49:53 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:49:54.270344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:54.271034 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:49:54.279915 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:54.280342 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:54.280767 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:54.281515 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:54.281959 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:54.282401 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:54.287717 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO oslo.messaging._drivers.impl_rabbit [-] [a199f6ed-2119-48f1-a8b4-499e20ba22d9] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37300. Oct 04 10:49:54.418523 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:49:54.426256 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-19ce0488-8871-4d12-8add-732ed83e305b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1578 microversion: 2.1 time: 0.160363 Oct 04 10:49:54.426819 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 560/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:49:54 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:49:55.448093 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:55.448736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:49:55.455479 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:55.455977 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:55.456392 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:55.457111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:55.457564 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:55.457983 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:55.520629 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:49:55.528646 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-277d4d26-ac65-4452-a40f-6e67790f8db1 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1510 microversion: 2.1 time: 0.084502 Oct 04 10:49:55.529766 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 544/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:49:55 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:49:55.652340 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-27689be5-dce1-4153-815e-27d19809fa72 req-b3bd8426-f970-4bbb-937c-efe9c9dc0925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a406a0-b453-4620-be3f-715c35059736", "name": "network-vif-deleted", "tag": "8b900ed3-ed54-448d-8baf-8c7dfec25c7e"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:49:55.662553 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-27689be5-dce1-4153-815e-27d19809fa72 req-b3bd8426-f970-4bbb-937c-efe9c9dc0925 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:55.663032 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-27689be5-dce1-4153-815e-27d19809fa72 req-b3bd8426-f970-4bbb-937c-efe9c9dc0925 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:55.663717 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-27689be5-dce1-4153-815e-27d19809fa72 req-b3bd8426-f970-4bbb-937c-efe9c9dc0925 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:55.675419 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-27689be5-dce1-4153-815e-27d19809fa72 req-b3bd8426-f970-4bbb-937c-efe9c9dc0925 service nova] Creating event network-vif-deleted:8b900ed3-ed54-448d-8baf-8c7dfec25c7e for instance 23a406a0-b453-4620-be3f-715c35059736 on hv-cinder-85919 Oct 04 10:49:55.688649 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-27689be5-dce1-4153-815e-27d19809fa72 req-b3bd8426-f970-4bbb-937c-efe9c9dc0925 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 Oct 04 10:49:55.688649 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 561/1105] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:49:56.552028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:56.552643 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:49:56.559129 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:56.559645 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:56.560088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:56.561445 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:56.561913 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:56.562340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:56.595544 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:56.596028 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:56.596459 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:56.596921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.objects.instance [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lazy-loading 'fault' on Instance uuid 23a406a0-b453-4620-be3f-715c35059736 {{(pid=127627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:49:56.641123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:49:56.648959 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-3ce95e50-d6ec-47e1-be2b-a57fada29a88 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 200 len: 1231 microversion: 2.1 time: 0.100847 Oct 04 10:49:56.649524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 545/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:49:56 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:49:57.673254 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:57.673991 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:49:57.680174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:57.680648 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:57.681111 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:57.681787 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:57.682232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:57.682653 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:57.696633 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] HTTP exception thrown: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Request method failure captured: Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 HTTP/1.1 Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA8uIxi5MKIjm8hpNoEOxkmT3jTHf5nl-wnIDB6KKN_AszjI-loTF19_IIwkjfzff00IQ3sntoyIO0uZoPDvSaSTgprn3GeOeCZuixjXjTRGXGQFOK_S58yhaoXt-p8D8YrlQW8FnUb-5yJ193-7DkGb5vYSqGLyuz_oKQPLeXbt0R0 Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:49:57.698301 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_90a1d65daca849b88e1054b8ea48e0e0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 807807d370a94aa6a312e51c7a8a2db2 Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:49:57.699889 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '23a406a0-b453-4620-be3f-715c35059736'} Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:49:57.701058 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:49:57.703347 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:49:57.704968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Returning 404 to user: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:49:57.704968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-500c5408-fa72-4c29-8f92-209e149cc940 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 404 len: 111 microversion: 2.1 time: 0.031517 Oct 04 10:49:57.704968 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 562/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:49:57 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:49:57.798044 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-692530119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2005908445", "security_groups": [{"name": "tempest-secgroup-smoke-1630351900"}], "block_device_mapping_v2": [{"uuid": "07f28f82-4327-46a7-9ab0-9819b7f67a78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "67809253-d647-4a6b-b83d-01e173cc834a"}]}} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:49:57.912477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.network.neutron [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] validate_networks() for [('67809253-d647-4a6b-b83d-01e173cc834a', None, None, None, None, None)] {{(pid=127627) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:49:58.376565 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Flavor limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:49:58.377029 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Image limits 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:49:58.377506 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Flavor pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:49:58.377914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Image pref 0:0:0 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:49:58.378323 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.virt.hardware [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:49:58.387041 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:58.387524 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:58.387964 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:58.388684 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:49:58.389171 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:49:58.389598 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:49:58.406809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:49:58.410770 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.quota [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for user 807807d370a94aa6a312e51c7a8a2db2 and project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:49:58.466687 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Going to run 1 instances... {{(pid=127627) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:49:58.469390 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07f28f82-4327-46a7-9ab0-9819b7f67a78',volume_size=None,volume_type=None)] {{(pid=127627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:49:58.916514 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-927a0b92-73ca-4dfa-b169-03c994241282 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.122470 Oct 04 10:49:58.917261 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 546/1108] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:49:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:49:58.928938 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d7ed66fb-2d47-4ee7-98c4-cc89ad44a49d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:58.929550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d7ed66fb-2d47-4ee7-98c4-cc89ad44a49d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:49:58.988875 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d7ed66fb-2d47-4ee7-98c4-cc89ad44a49d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:49:58.995760 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d7ed66fb-2d47-4ee7-98c4-cc89ad44a49d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1094 microversion: 2.1 time: 0.070618 Oct 04 10:49:58.996313 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 563/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:49:58 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:00.028900 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:00.029537 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:00.037049 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:00.037543 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:00.038123 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:00.038844 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:00.039304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:00.039739 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:00.101148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:00.108838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d66f2b7d-3936-4673-a0ba-404144c02055 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1136 microversion: 2.1 time: 0.084346 Oct 04 10:50:00.109419 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 547/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:00 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:01.132132 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:01.132774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:01.141158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:01.144789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:01.144789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:01.144789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:01.144789 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:01.145240 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:01.234324 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:01.242081 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-19cfe0d2-e65e-4968-9855-06623acdd248 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1210 microversion: 2.1 time: 0.113784 Oct 04 10:50:01.242657 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 564/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:01 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:02.265407 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:02.266197 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:02.273805 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:02.274292 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:02.274731 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:02.275425 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:02.275958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:02.276384 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:02.416374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:02.424689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-110ab9a4-bd2a-46df-b264-8cf7ed825e1d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1278 microversion: 2.1 time: 0.162648 Oct 04 10:50:02.426469 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 548/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:02 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:02.790473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-6bedcfc1-3e10-4233-99ba-a98bf494ae0b req-22bd8701-9d96-4a5e-a1ff-866632ed9386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5718478e-c609-47a1-a784-ad385a7a2fca", "tag": "5c36163e-0acb-4356-8dc5-ec1e2c3d64cc"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:02.801483 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-6bedcfc1-3e10-4233-99ba-a98bf494ae0b req-22bd8701-9d96-4a5e-a1ff-866632ed9386 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:02.801958 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-6bedcfc1-3e10-4233-99ba-a98bf494ae0b req-22bd8701-9d96-4a5e-a1ff-866632ed9386 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:02.802397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-6bedcfc1-3e10-4233-99ba-a98bf494ae0b req-22bd8701-9d96-4a5e-a1ff-866632ed9386 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:02.813847 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-6bedcfc1-3e10-4233-99ba-a98bf494ae0b req-22bd8701-9d96-4a5e-a1ff-866632ed9386 service nova] Creating event network-changed:5c36163e-0acb-4356-8dc5-ec1e2c3d64cc for instance 5718478e-c609-47a1-a784-ad385a7a2fca on hv-cinder-85919 Oct 04 10:50:02.819564 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-6bedcfc1-3e10-4233-99ba-a98bf494ae0b req-22bd8701-9d96-4a5e-a1ff-866632ed9386 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Oct 04 10:50:02.820232 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 565/1113] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:03.447052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:03.447752 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:03.454190 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:03.454674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:03.455111 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:03.455811 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:03.456269 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:03.456728 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:03.593256 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:03.601583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-1e849240-5380-4b68-be22-2990ee033f3b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.158441 Oct 04 10:50:03.602148 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 549/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:03 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:04.625838 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:04.626531 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:04.633462 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:04.633943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:04.634375 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:04.635051 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:04.635500 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:04.635923 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:04.883903 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:04.892692 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-718397c1-34f8-45fb-b654-0727ebe5112a tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.271365 Oct 04 10:50:04.893375 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 566/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:04 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:05.915716 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:05.916281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:05.922674 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:05.923150 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:05.923587 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:05.924487 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:05.924965 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:05.925396 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:06.102016 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:06.109892 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-f7bef3e2-ac4c-4609-8755-9e1dc7ec75b4 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.198108 Oct 04 10:50:06.110456 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 550/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:05 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:07.132943 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:07.133629 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:07.139907 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:07.140381 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:07.140816 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:07.141517 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:07.141972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:07.143046 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:07.276365 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:07.284165 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-78acb451-9ed6-4edf-bf23-d9f347c242b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.155134 Oct 04 10:50:07.284724 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 567/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:07 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:08.306409 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:08.307009 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:08.313161 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:08.313678 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:08.314122 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:08.314843 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:08.315296 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:08.315730 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:08.401144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:08.417070 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=6 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:08.462144 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:08.466590 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-7960d6b2-5ce7-4912-a159-9ae0e210ab03 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.164065 Oct 04 10:50:08.467156 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 551/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:08 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:09.490549 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:09.491167 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:09.493578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:09.498260 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:09.498739 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:09.499175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:09.499861 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:09.500315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:09.500738 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:09.631912 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:09.640083 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b310f7fb-44dc-496b-bf05-5e78e00a0572 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.153988 Oct 04 10:50:09.640602 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 568/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:09 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:10.662924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:10.663535 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:10.670195 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:10.670690 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:10.671133 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:10.671844 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:10.672304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:10.672732 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:10.840136 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:10.848212 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-73d64219-cb44-4adc-ae1a-2fae0ef41d4d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.189355 Oct 04 10:50:10.848785 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 552/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:10 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:11.871380 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:11.871929 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:11.879043 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:11.879535 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:11.879975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:11.880667 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:11.881187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:11.881647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:12.017426 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:12.025397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9204b973-66c7-476b-95e9-d74a36181ba9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.157935 Oct 04 10:50:12.025982 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 569/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:11 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:12.230541 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-38d8bfa6-7657-4d32-904f-7f770d60090a req-f5d98bb0-c2f2-433b-9a69-dbc5128052e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5718478e-c609-47a1-a784-ad385a7a2fca", "name": "network-vif-plugged", "status": "completed", "tag": "5c36163e-0acb-4356-8dc5-ec1e2c3d64cc"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:12.241374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-38d8bfa6-7657-4d32-904f-7f770d60090a req-f5d98bb0-c2f2-433b-9a69-dbc5128052e5 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:12.241851 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-38d8bfa6-7657-4d32-904f-7f770d60090a req-f5d98bb0-c2f2-433b-9a69-dbc5128052e5 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:12.242281 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-38d8bfa6-7657-4d32-904f-7f770d60090a req-f5d98bb0-c2f2-433b-9a69-dbc5128052e5 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:12.255948 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-38d8bfa6-7657-4d32-904f-7f770d60090a req-f5d98bb0-c2f2-433b-9a69-dbc5128052e5 service nova] Creating event network-vif-plugged:5c36163e-0acb-4356-8dc5-ec1e2c3d64cc for instance 5718478e-c609-47a1-a784-ad385a7a2fca on hv-cinder-85919 Oct 04 10:50:12.260966 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-38d8bfa6-7657-4d32-904f-7f770d60090a req-f5d98bb0-c2f2-433b-9a69-dbc5128052e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034141 Oct 04 10:50:12.265840 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 553/1122] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:13.048186 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:13.048831 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:13.055458 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:13.055941 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:13.056378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:13.057104 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:13.057558 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:13.057983 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:13.188882 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:13.197048 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-fabe105a-0416-4666-bfe7-71b24c9d87b8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1266 microversion: 2.1 time: 0.152673 Oct 04 10:50:13.199570 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 570/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:13 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:14.223126 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:14.223822 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:14.229995 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:14.230473 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:14.230906 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:14.231588 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:14.232041 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:14.232464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:14.369497 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:14.377366 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ec488fad-eb85-4e93-b8e5-bad56de3baec tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1452 microversion: 2.1 time: 0.159449 Oct 04 10:50:14.377896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 554/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:14 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:14.400006 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:14.400619 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:50:14.407239 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:14.407734 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:14.408772 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:14.409540 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:14.409996 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:14.410424 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:14.540314 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:50:14.547962 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3d172376-857d-40ed-b601-4b41428668da tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1452 microversion: 2.1 time: 0.151858 Oct 04 10:50:14.549037 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 571/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:50:14 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:16.419482 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-1ab5b262-2980-4d8d-a61f-70fcd033eb2b req-da1b96dd-5a73-48d7-873b-193ebaa1e5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5718478e-c609-47a1-a784-ad385a7a2fca", "tag": "5c36163e-0acb-4356-8dc5-ec1e2c3d64cc"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:16.430042 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-1ab5b262-2980-4d8d-a61f-70fcd033eb2b req-da1b96dd-5a73-48d7-873b-193ebaa1e5da service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:50:16.430527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-1ab5b262-2980-4d8d-a61f-70fcd033eb2b req-da1b96dd-5a73-48d7-873b-193ebaa1e5da service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:50:16.430958 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-1ab5b262-2980-4d8d-a61f-70fcd033eb2b req-da1b96dd-5a73-48d7-873b-193ebaa1e5da service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:50:16.441921 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-1ab5b262-2980-4d8d-a61f-70fcd033eb2b req-da1b96dd-5a73-48d7-873b-193ebaa1e5da service nova] Creating event network-changed:5c36163e-0acb-4356-8dc5-ec1e2c3d64cc for instance 5718478e-c609-47a1-a784-ad385a7a2fca on hv-cinder-85919 Oct 04 10:50:16.446910 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-1ab5b262-2980-4d8d-a61f-70fcd033eb2b req-da1b96dd-5a73-48d7-873b-193ebaa1e5da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031182 Oct 04 10:50:16.447696 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 555/1126] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:52.274510 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 10:51:52.275035 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Tue Oct 4 10:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 04 10:51:52.276046 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:51:52.276373 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:51:52.281413 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1516180707", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2005908445", "security_groups": [{"name": "tempest-secgroup-smoke-1630351900"}], "block_device_mapping_v2": [{"uuid": "57797d26-7ca2-47aa-8522-496d439fa0d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "67809253-d647-4a6b-b83d-01e173cc834a"}]}} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:51:52.395027 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.network.neutron [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] validate_networks() for [('67809253-d647-4a6b-b83d-01e173cc834a', None, None, None, None, None)] {{(pid=127628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:51:52.777423 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Flavor limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:51:52.777866 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Image limits 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:51:52.778329 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Flavor pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:51:52.778727 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Image pref 0:0:0 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:51:52.779188 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.virt.hardware [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:51:52.787909 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:52.788378 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:52.788897 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:52.789613 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:52.790057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:52.790473 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:52.807414 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:51:52.812158 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.quota [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Getting quotas for user 807807d370a94aa6a312e51c7a8a2db2 and project 90a1d65daca849b88e1054b8ea48e0e0. Resources: {'instances', 'ram', 'cores'} {{(pid=127628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:51:52.868160 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Going to run 1 instances... {{(pid=127628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:51:52.870316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57797d26-7ca2-47aa-8522-496d439fa0d8',volume_size=None,volume_type=None)] {{(pid=127628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:51:53.265152 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-27d41c68-344e-4058-8492-77e62172b328 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.992303 Oct 04 10:51:53.265800 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 572/1127] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 10:51:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:51:53.276169 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 10:51:53.276727 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Tue Oct 4 10:51:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 (ip 10.222.0.42) !!! Oct 04 10:51:53.278145 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:51:53.280361 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=68 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:51:53.292304 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-76872592-71a8-4483-86d1-11fc9ea015ba tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:53.293139 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-76872592-71a8-4483-86d1-11fc9ea015ba tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:51:53.349088 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-76872592-71a8-4483-86d1-11fc9ea015ba tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:51:53.356527 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-76872592-71a8-4483-86d1-11fc9ea015ba tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1095 microversion: 2.1 time: 0.083484 Oct 04 10:51:53.357189 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 556/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:51:53 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:51:54.380397 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:54.381028 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:51:54.387024 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:54.387508 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:54.387949 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:54.388783 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:54.389270 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:54.389696 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:54.454675 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:51:54.462408 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-0d1fdd68-1ce0-4e7c-86a7-e528b43fe2a9 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1137 microversion: 2.1 time: 0.086568 Oct 04 10:51:54.463244 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 573/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:51:54 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:51:55.486019 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:55.486655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:51:55.493464 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:55.493936 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:55.494369 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:55.495047 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:55.495496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:55.495914 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:55.561226 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:51:55.569356 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-e1a3bda6-2236-45d4-b332-1265785cf2f3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1211 microversion: 2.1 time: 0.087472 Oct 04 10:51:55.569934 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 557/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:51:55 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:51:56.594298 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:56.594864 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:51:56.605285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:56.605285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:56.605285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:56.605285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:56.605677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:56.605677 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:56.861344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:51:56.869174 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-d7b2af44-0452-4f71-ae4f-9bcd1948b112 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1279 microversion: 2.1 time: 0.279882 Oct 04 10:51:56.869796 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 574/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:51:56 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:51:57.139854 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-5c19e4df-b45c-4a67-82e6-89d326677f89 req-b545e86a-d324-4e87-b205-7814cfd971dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9788a15a-ea55-4df4-a5a1-27bca6b5d154", "tag": "037a97c9-231d-46d2-9df4-ca2ff42cee73"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:51:57.149371 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5c19e4df-b45c-4a67-82e6-89d326677f89 req-b545e86a-d324-4e87-b205-7814cfd971dc service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:57.149853 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5c19e4df-b45c-4a67-82e6-89d326677f89 req-b545e86a-d324-4e87-b205-7814cfd971dc service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:57.150287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-5c19e4df-b45c-4a67-82e6-89d326677f89 req-b545e86a-d324-4e87-b205-7814cfd971dc service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:57.160833 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-5c19e4df-b45c-4a67-82e6-89d326677f89 req-b545e86a-d324-4e87-b205-7814cfd971dc service nova] Creating event network-changed:037a97c9-231d-46d2-9df4-ca2ff42cee73 for instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 on hv-cinder-85919 Oct 04 10:51:57.165869 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-5c19e4df-b45c-4a67-82e6-89d326677f89 req-b545e86a-d324-4e87-b205-7814cfd971dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094003 Oct 04 10:51:57.166451 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 558/1132] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:57.893528 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:57.894226 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:51:57.900368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:57.900851 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:57.901311 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:57.902002 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:57.902450 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:57.902877 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:58.034040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:51:58.041683 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-b0c1a5a8-e2e1-4c2e-9ea5-6252455bf3b3 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.151903 Oct 04 10:51:58.042183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 575/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:51:57 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:51:59.065620 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:59.066327 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:51:59.072981 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:59.073467 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:59.073905 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:59.074594 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:51:59.075052 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:51:59.075477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:51:59.206321 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:51:59.214079 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ef04b97b-9556-42f7-bbe6-d44d6aeb9e72 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.152643 Oct 04 10:51:59.214684 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 559/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:51:59 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:00.242249 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:00.242973 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:00.250087 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:00.250570 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:00.251004 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:00.251687 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:00.252130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:00.252550 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:00.380686 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:00.388263 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-9e7251e3-a253-4665-aae0-308e1cd6ba97 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.149798 Oct 04 10:52:00.389040 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 576/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:00 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:01.410681 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:01.411301 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:01.417700 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:01.418177 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:01.418612 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:01.419294 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:01.419740 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:01.420162 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:01.552931 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:01.561477 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-bd1a8b95-6a22-455b-8584-74251ac38a81 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.154578 Oct 04 10:52:01.562224 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 560/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:01 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:02.583606 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:02.584259 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:02.590703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:02.592052 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:02.592685 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:02.593196 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:02.593650 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:02.594076 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:02.725488 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:02.733584 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-8cd5a93c-cb08-489d-9f1f-5f59b2ebc489 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.153888 Oct 04 10:52:02.734157 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 577/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:02 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:03.756885 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:03.757503 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:03.760012 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell0:SELECT=2 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:52:03.765672 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:03.766159 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:03.766596 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:03.767287 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:03.767744 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:03.768170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:03.900746 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:03.908496 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-0f826743-a7f9-4253-b29b-8d0e5641f05e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.155534 Oct 04 10:52:03.909080 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 561/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:03 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:04.931351 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:04.931903 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:04.933722 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=2 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:52:04.934407 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell0:SELECT=6 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:52:04.939715 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:04.940187 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:04.940616 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:04.941324 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:04.941773 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:04.942241 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:05.073924 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:05.081751 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-3f6d7a5e-9461-4edb-8ee2-7da1e1f3088c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.154391 Oct 04 10:52:05.082316 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 578/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:04 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:06.107509 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:06.108187 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:06.114603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:06.115084 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:06.115521 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:06.116208 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:06.116660 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:06.117118 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:06.248318 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:06.256901 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-6346c645-1720-4527-b1e1-1fe1c2809431 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.155597 Oct 04 10:52:06.257473 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 562/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:06 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:06.772089 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-203b27e1-f558-47b6-8192-4acbcd1da099 req-8f8a85f1-3b32-4c52-a49c-649779597ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9788a15a-ea55-4df4-a5a1-27bca6b5d154", "name": "network-vif-plugged", "status": "completed", "tag": "037a97c9-231d-46d2-9df4-ca2ff42cee73"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:52:06.782699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-203b27e1-f558-47b6-8192-4acbcd1da099 req-8f8a85f1-3b32-4c52-a49c-649779597ad4 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:06.783175 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-203b27e1-f558-47b6-8192-4acbcd1da099 req-8f8a85f1-3b32-4c52-a49c-649779597ad4 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:06.783604 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-203b27e1-f558-47b6-8192-4acbcd1da099 req-8f8a85f1-3b32-4c52-a49c-649779597ad4 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:06.794306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-203b27e1-f558-47b6-8192-4acbcd1da099 req-8f8a85f1-3b32-4c52-a49c-649779597ad4 service nova] Creating event network-vif-plugged:037a97c9-231d-46d2-9df4-ca2ff42cee73 for instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 on hv-cinder-85919 Oct 04 10:52:06.799795 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-203b27e1-f558-47b6-8192-4acbcd1da099 req-8f8a85f1-3b32-4c52-a49c-649779597ad4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Oct 04 10:52:06.805036 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 579/1141] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:52:07.278883 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:07.279490 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:07.285827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:07.286305 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:07.286734 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:07.287414 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:07.287864 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:07.288284 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:07.419312 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:07.426968 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5b8880ee-1163-4b05-a2a4-c27a310f0a0e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1267 microversion: 2.1 time: 0.151939 Oct 04 10:52:07.427526 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 563/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:07 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:08.450963 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:08.452194 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:08.460786 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:08.461298 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:08.464841 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:08.464841 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:08.464841 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:08.464841 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:08.595800 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:08.603885 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-58baf014-84f2-4bec-9650-d396f7fbd313 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1453 microversion: 2.1 time: 0.157453 Oct 04 10:52:08.604453 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 580/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:08 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:52:08.626666 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:08.627324 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:52:08.633924 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:08.637951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:08.637951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:08.637951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:08.637951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:08.638370 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:08.768559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:52:08.776280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-d110eaf2-28f6-4082-b8e0-575a4010c83c tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1453 microversion: 2.1 time: 0.153961 Oct 04 10:52:08.776840 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 564/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:52:08 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:11.032764 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-ac4a835d-18f4-434b-8060-028649d36091 req-58895699-9b8b-46a9-b7ec-5f3ab0f29660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9788a15a-ea55-4df4-a5a1-27bca6b5d154", "tag": "037a97c9-231d-46d2-9df4-ca2ff42cee73"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:52:11.042492 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ac4a835d-18f4-434b-8060-028649d36091 req-58895699-9b8b-46a9-b7ec-5f3ab0f29660 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:52:11.042955 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ac4a835d-18f4-434b-8060-028649d36091 req-58895699-9b8b-46a9-b7ec-5f3ab0f29660 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:52:11.043388 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ac4a835d-18f4-434b-8060-028649d36091 req-58895699-9b8b-46a9-b7ec-5f3ab0f29660 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:52:11.058392 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-ac4a835d-18f4-434b-8060-028649d36091 req-58895699-9b8b-46a9-b7ec-5f3ab0f29660 service nova] Creating event network-changed:037a97c9-231d-46d2-9df4-ca2ff42cee73 for instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 on hv-cinder-85919 Oct 04 10:52:11.063708 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-ac4a835d-18f4-434b-8060-028649d36091 req-58895699-9b8b-46a9-b7ec-5f3ab0f29660 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108651 Oct 04 10:52:11.064315 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 581/1145] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:53:43.277909 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:43.278460 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:53:43.278841 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG dbcounter [-] [127628] Writing DB stats nova_cell1:SELECT=48 {{(pid=127628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:53:43.278937 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:43.281179 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_api:SELECT=20 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:53:43.281846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG dbcounter [-] [127627] Writing DB stats nova_cell1:SELECT=44 {{(pid=127627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:53:43.283149 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 10:53:43.283282 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Tue Oct 4 10:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 (ip 10.222.0.42) !!! Oct 04 10:53:43.284319 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-ac2aea67-f2ab-4c8b-b028-77b1aadd5345 req-c0567ce6-99e9-4943-af6a-d77242fc187f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9788a15a-ea55-4df4-a5a1-27bca6b5d154", "tag": "037a97c9-231d-46d2-9df4-ca2ff42cee73"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:53:43.290014 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:43.290824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:43.291493 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:43.292209 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:43.292662 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:43.293350 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:43.296183 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ac2aea67-f2ab-4c8b-b028-77b1aadd5345 req-c0567ce6-99e9-4943-af6a-d77242fc187f service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:43.297746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ac2aea67-f2ab-4c8b-b028-77b1aadd5345 req-c0567ce6-99e9-4943-af6a-d77242fc187f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:43.297746 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-ac2aea67-f2ab-4c8b-b028-77b1aadd5345 req-c0567ce6-99e9-4943-af6a-d77242fc187f service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:43.312261 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-ac2aea67-f2ab-4c8b-b028-77b1aadd5345 req-c0567ce6-99e9-4943-af6a-d77242fc187f service nova] Creating event network-changed:037a97c9-231d-46d2-9df4-ca2ff42cee73 for instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 on hv-cinder-85919 Oct 04 10:53:43.318815 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-ac2aea67-f2ab-4c8b-b028-77b1aadd5345 req-c0567ce6-99e9-4943-af6a-d77242fc187f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042631 Oct 04 10:53:43.320368 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 582/1146] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:53:43.334333 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Going to try to terminate instance {{(pid=127627) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:53:43.619864 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-ecee0767-5800-4f5c-8921-58275bb5f4ab tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 204 len: 0 microversion: 2.1 time: 0.346608 Oct 04 10:53:43.621401 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 565/1147] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:53:43 2022] DELETE /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:53:43.631530 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:43.632360 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:43.640118 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:43.640976 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:43.641485 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:43.642235 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:43.642805 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:43.643377 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:43.781969 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:53:43.790294 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-545a2615-44d2-4346-8b82-34ef3162e224 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1577 microversion: 2.1 time: 0.164554 Oct 04 10:53:43.791283 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 583/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:43 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:53:44.814668 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:44.815639 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:44.822779 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:44.823263 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:44.823698 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:44.824395 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:44.824846 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:44.825299 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:44.961673 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:53:44.969581 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8a5fb439-40cb-4b88-a6df-a0ce02ab5f6e tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1577 microversion: 2.1 time: 0.159290 Oct 04 10:53:44.971848 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 566/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:44 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:53:45.928578 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [req-43e2549d-9880-4aec-ac9d-64c12f6c7223 req-95a0e74d-5b80-4f00-a642-0df65a252513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9788a15a-ea55-4df4-a5a1-27bca6b5d154", "name": "network-vif-deleted", "tag": "037a97c9-231d-46d2-9df4-ca2ff42cee73"}]} {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:53:45.938425 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-43e2549d-9880-4aec-ac9d-64c12f6c7223 req-95a0e74d-5b80-4f00-a642-0df65a252513 service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:45.938972 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-43e2549d-9880-4aec-ac9d-64c12f6c7223 req-95a0e74d-5b80-4f00-a642-0df65a252513 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:45.939480 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [req-43e2549d-9880-4aec-ac9d-64c12f6c7223 req-95a0e74d-5b80-4f00-a642-0df65a252513 service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:45.950840 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.compute.server_external_events [req-43e2549d-9880-4aec-ac9d-64c12f6c7223 req-95a0e74d-5b80-4f00-a642-0df65a252513 service nova] Creating event network-vif-deleted:037a97c9-231d-46d2-9df4-ca2ff42cee73 for instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 on hv-cinder-85919 Oct 04 10:53:45.955559 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [req-43e2549d-9880-4aec-ac9d-64c12f6c7223 req-95a0e74d-5b80-4f00-a642-0df65a252513 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030959 Oct 04 10:53:45.956141 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 584/1150] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:53:45.991748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:45.992364 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:45.998725 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:45.999214 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:45.999655 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:46.000380 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:46.000838 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:46.004067 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:46.073046 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:53:46.080870 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-8ff36ce0-1f42-45ad-9fca-683d580586ff tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1391 microversion: 2.1 time: 0.093126 Oct 04 10:53:46.081501 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 567/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:45 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:53:47.105701 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:47.106499 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:47.113480 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:47.113976 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:47.114449 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:47.115150 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:47.115605 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:47.116033 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:47.146942 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:47.147353 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:47.147817 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:47.148285 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.objects.instance [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lazy-loading 'fault' on Instance uuid 9788a15a-ea55-4df4-a5a1-27bca6b5d154 {{(pid=127628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 10:53:47.189476 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:53:47.197852 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-939e0127-1e8c-4fc7-91fc-711d6568a376 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 200 len: 1231 microversion: 2.1 time: 0.096756 Oct 04 10:53:47.198417 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 585/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:47 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:53:48.221847 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:48.223344 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 9788a15a-ea55-4df4-a5a1-27bca6b5d154] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:48.229809 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:48.230299 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:48.230736 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:48.231434 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:48.231911 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:48.232340 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:48.247228 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] HTTP exception thrown: Instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 could not be found. Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Request method failure captured: Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 HTTP/1.1 Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA8uIxi5MKIjm8hpNoEOxkmT3jTHf5nl-wnIDB6KKN_AszjI-loTF19_IIwkjfzff00IQ3sntoyIO0uZoPDvSaSTgprn3GeOeCZuixjXjTRGXGQFOK_S58yhaoXt-p8D8YrlQW8FnUb-5yJ193-7DkGb5vYSqGLyuz_oKQPLeXbt0R0 Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:53:48.248896 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_90a1d65daca849b88e1054b8ea48e0e0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 807807d370a94aa6a312e51c7a8a2db2 Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 could not be found. Oct 04 10:53:48.250606 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '9788a15a-ea55-4df4-a5a1-27bca6b5d154'} Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 could not be found. Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:53:48.251650 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 could not be found. Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 could not be found. Oct 04 10:53:48.253748 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:48.255478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Returning 404 to user: Instance 9788a15a-ea55-4df4-a5a1-27bca6b5d154 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:53:48.255478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-5bfe69eb-227e-4d69-8d0c-8148c96571b6 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154" status: 404 len: 111 microversion: 2.1 time: 0.032364 Oct 04 10:53:48.255478 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 568/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:48 2022] GET /compute/v2.1/servers/9788a15a-ea55-4df4-a5a1-27bca6b5d154 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:53:51.646017 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:51.646903 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:51.647417 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-f8eee5c9-b233-4eda-99fd-f28958ca56cb req-3ea8283d-82c4-4321-aa4e-6bee89e89fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5718478e-c609-47a1-a784-ad385a7a2fca", "tag": "5c36163e-0acb-4356-8dc5-ec1e2c3d64cc"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:53:51.654442 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:51.654892 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:51.655325 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:51.656057 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:51.656710 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:51.657478 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:51.658420 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f8eee5c9-b233-4eda-99fd-f28958ca56cb req-3ea8283d-82c4-4321-aa4e-6bee89e89fdd service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:51.659066 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f8eee5c9-b233-4eda-99fd-f28958ca56cb req-3ea8283d-82c4-4321-aa4e-6bee89e89fdd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:51.659603 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-f8eee5c9-b233-4eda-99fd-f28958ca56cb req-3ea8283d-82c4-4321-aa4e-6bee89e89fdd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:51.672668 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-f8eee5c9-b233-4eda-99fd-f28958ca56cb req-3ea8283d-82c4-4321-aa4e-6bee89e89fdd service nova] Creating event network-changed:5c36163e-0acb-4356-8dc5-ec1e2c3d64cc for instance 5718478e-c609-47a1-a784-ad385a7a2fca on hv-cinder-85919 Oct 04 10:53:51.678792 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-f8eee5c9-b233-4eda-99fd-f28958ca56cb req-3ea8283d-82c4-4321-aa4e-6bee89e89fdd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035667 Oct 04 10:53:51.685699 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Going to try to terminate instance {{(pid=127628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:53:51.687890 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 569/1154] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:53:51.960302 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-c9ed6feb-a239-4f13-9d76-21ddf427d607 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 204 len: 0 microversion: 2.1 time: 0.319027 Oct 04 10:53:51.961745 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 586/1155] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:53:51 2022] DELETE /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:53:51.970232 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:51.970927 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:51.978523 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:51.979013 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:51.979452 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:51.980783 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:51.981446 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:51.981706 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:52.126194 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.policy [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127627) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:53:52.135786 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-13771d89-75a3-4d43-bbfd-5213ab390972 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1576 microversion: 2.1 time: 0.169935 Oct 04 10:53:52.136374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 570/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:51 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:53:53.166219 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:53.166975 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:53.173435 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:53.173922 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:53.174363 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:53.176774 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:53.177356 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:53.177765 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:53.366647 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:53:53.374321 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-e2e00332-2551-4150-b6c5-b4f204ad650d tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1576 microversion: 2.1 time: 0.212490 Oct 04 10:53:53.374888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 587/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:53 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:53:54.149511 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [req-2fb64983-1856-489f-862b-50968bbcf392 req-3505d986-f6a7-44b3-afb7-e5f91998dffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5718478e-c609-47a1-a784-ad385a7a2fca", "name": "network-vif-deleted", "tag": "5c36163e-0acb-4356-8dc5-ec1e2c3d64cc"}]} {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:53:54.159824 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-2fb64983-1856-489f-862b-50968bbcf392 req-3505d986-f6a7-44b3-afb7-e5f91998dffd service nova] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:54.160302 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-2fb64983-1856-489f-862b-50968bbcf392 req-3505d986-f6a7-44b3-afb7-e5f91998dffd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:54.160738 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [req-2fb64983-1856-489f-862b-50968bbcf392 req-3505d986-f6a7-44b3-afb7-e5f91998dffd service nova] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:54.171563 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.compute.server_external_events [req-2fb64983-1856-489f-862b-50968bbcf392 req-3505d986-f6a7-44b3-afb7-e5f91998dffd service nova] Creating event network-vif-deleted:5c36163e-0acb-4356-8dc5-ec1e2c3d64cc for instance 5718478e-c609-47a1-a784-ad385a7a2fca on hv-cinder-85919 Oct 04 10:53:54.176707 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [req-2fb64983-1856-489f-862b-50968bbcf392 req-3505d986-f6a7-44b3-afb7-e5f91998dffd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030819 Oct 04 10:53:54.177345 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 571/1158] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 10:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:53:54.397586 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:54.398164 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:54.403982 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:54.404458 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:54.404917 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:54.405607 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:54.406053 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:54.406502 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:54.470906 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.policy [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807807d370a94aa6a312e51c7a8a2db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a1d65daca849b88e1054b8ea48e0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:53:54.479064 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-eab11f74-56ae-4f57-a39b-37a405829993 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 200 len: 1225 microversion: 2.1 time: 0.086100 Oct 04 10:53:54.482888 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 588/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:54 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:53:55.503856 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:55.504475 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 5718478e-c609-47a1-a784-ad385a7a2fca] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:55.510600 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:55.511108 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:55.511559 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:55.512239 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:55.512689 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:55.513170 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:55.526687 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] HTTP exception thrown: Instance 5718478e-c609-47a1-a784-ad385a7a2fca could not be found. Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Request method failure captured: Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca HTTP/1.1 Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA8uIxi5MKIjm8hpNoEOxkmT3jTHf5nl-wnIDB6KKN_AszjI-loTF19_IIwkjfzff00IQ3sntoyIO0uZoPDvSaSTgprn3GeOeCZuixjXjTRGXGQFOK_S58yhaoXt-p8D8YrlQW8FnUb-5yJ193-7DkGb5vYSqGLyuz_oKQPLeXbt0R0 Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:53:55.528288 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_90a1d65daca849b88e1054b8ea48e0e0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 807807d370a94aa6a312e51c7a8a2db2 Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 5718478e-c609-47a1-a784-ad385a7a2fca could not be found. Oct 04 10:53:55.530158 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '5718478e-c609-47a1-a784-ad385a7a2fca'} Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5718478e-c609-47a1-a784-ad385a7a2fca could not be found. Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:53:55.531525 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5718478e-c609-47a1-a784-ad385a7a2fca could not be found. Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5718478e-c609-47a1-a784-ad385a7a2fca could not be found. Oct 04 10:53:55.533257 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:55.535476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Returning 404 to user: Instance 5718478e-c609-47a1-a784-ad385a7a2fca could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:53:55.535476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-81651adc-a2ed-453c-af0e-a9b8eba71b50 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca" status: 404 len: 111 microversion: 2.1 time: 0.030810 Oct 04 10:53:55.535476 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 572/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:55 2022] GET /compute/v2.1/servers/5718478e-c609-47a1-a784-ad385a7a2fca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:53:56.035130 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:56.035664 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.compute.api [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:56.042703 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:56.043178 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:56.043636 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:56.044344 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:56.044780 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:56.045212 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG oslo_concurrency.lockutils [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:56.058306 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.wsgi [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] HTTP exception thrown: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Request method failure captured: Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: request: DELETE /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 HTTP/1.1 Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept: application/json Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Accept-Encoding: identity Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Connection: close Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Length: 0 Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Content-Type: application/json Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Host: 10.222.0.42 Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: Openstack-System-Scope: None Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: User-Agent: python-urllib3/1.26.12 Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Auth-Token: gAAAAABjPA8uIxi5MKIjm8hpNoEOxkmT3jTHf5nl-wnIDB6KKN_AszjI-loTF19_IIwkjfzff00IQ3sntoyIO0uZoPDvSaSTgprn3GeOeCZuixjXjTRGXGQFOK_S58yhaoXt-p8D8YrlQW8FnUb-5yJ193-7DkGb5vYSqGLyuz_oKQPLeXbt0R0 Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Id: None Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Domain-Name: None Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Identity-Status: Confirmed Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Is-Admin-Project: True Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Id: default Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Domain-Name: Default Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Project-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Role: reader,member Oct 04 10:53:56.060044 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Roles: reader,member Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_90a1d65daca849b88e1054b8ea48e0e0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-Tenant-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Id: default Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Domain-Name: Default Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Id: 807807d370a94aa6a312e51c7a8a2db2 Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: X-User-Name: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: method: > Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: exception: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.061966 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: action_args: {'id': '23a406a0-b453-4620-be3f-715c35059736'} Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:53:56.062867 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.064334 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.065848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Returning 404 to user: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. {{(pid=127628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:53:56.065848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-47a5c9dc-6608-4e3b-a1c5-585062cfc682 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 404 len: 111 microversion: 2.1 time: 0.030193 Oct 04 10:53:56.065848 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 589/1161] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 10:53:56 2022] DELETE /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:53:56.069976 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '>' {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:56.070583 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.compute.api [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] [instance: 23a406a0-b453-4620-be3f-715c35059736] Fetching instance by UUID {{(pid=127627) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:53:56.076437 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:56.076941 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:56.077374 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:56.078082 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Acquiring lock "79d10631-ae89-4124-98da-b4c2efdbdef3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:53:56.078533 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:53:56.078951 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG oslo_concurrency.lockutils [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Lock "79d10631-ae89-4124-98da-b4c2efdbdef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:53:56.093010 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.wsgi [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] HTTP exception thrown: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Request method failure captured: Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: request: GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 HTTP/1.1 Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept: application/json Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Accept-Encoding: identity Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Connection: close Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Length: 0 Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Content-Type: application/json Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Host: 10.222.0.42 Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: Openstack-System-Scope: None Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: User-Agent: python-urllib3/1.26.12 Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Auth-Token: gAAAAABjPA8uIxi5MKIjm8hpNoEOxkmT3jTHf5nl-wnIDB6KKN_AszjI-loTF19_IIwkjfzff00IQ3sntoyIO0uZoPDvSaSTgprn3GeOeCZuixjXjTRGXGQFOK_S58yhaoXt-p8D8YrlQW8FnUb-5yJ193-7DkGb5vYSqGLyuz_oKQPLeXbt0R0 Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Id: None Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Domain-Name: None Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Identity-Status: Confirmed Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Is-Admin-Project: True Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Id: default Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Domain-Name: Default Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Project-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Role: reader,member Oct 04 10:53:56.094550 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Roles: reader,member Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_90a1d65daca849b88e1054b8ea48e0e0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90a1d65daca849b88e1054b8ea48e0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Id: 90a1d65daca849b88e1054b8ea48e0e0 Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-Tenant-Name: tempest-TestVolumeBootPattern-2057350606 Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Id: default Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Domain-Name: Default Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Id: 807807d370a94aa6a312e51c7a8a2db2 Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: X-User-Name: tempest-TestVolumeBootPattern-2057350606-project Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: method: > Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: exception: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.096338 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: action_args: {'id': '23a406a0-b453-4620-be3f-715c35059736'} Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: {{(pid=127627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:53:56.098249 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. Oct 04 10:53:56.099827 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: ERROR nova.api.openstack.wsgi Oct 04 10:53:56.101280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: DEBUG nova.api.openstack.wsgi [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Returning 404 to user: Instance 23a406a0-b453-4620-be3f-715c35059736 could not be found. {{(pid=127627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:53:56.101280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: INFO nova.api.openstack.requestlog [None req-b5e9a56d-607d-4f7b-a4e6-0d341303dc7b tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736" status: 404 len: 111 microversion: 2.1 time: 0.029795 Oct 04 10:53:56.101280 dv-cinder-859193-3-iscsi devstack@n-api.service[127627]: [pid: 127627|app: 0|req: 573/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 10:53:56 2022] GET /compute/v2.1/servers/23a406a0-b453-4620-be3f-715c35059736 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:53:57.558562 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: DEBUG nova.api.openstack.wsgi [None req-110183ac-33b4-46e4-ad38-3196ebf1b9f8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] Calling method '.version_select at 0x7f9be92dbe50>' {{(pid=127628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:53:57.635317 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: INFO nova.api.openstack.requestlog [None req-110183ac-33b4-46e4-ad38-3196ebf1b9f8 tempest-TestVolumeBootPattern-2057350606 tempest-TestVolumeBootPattern-2057350606-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2005908445" status: 202 len: 0 microversion: 2.1 time: 0.080494 Oct 04 10:53:57.635902 dv-cinder-859193-3-iscsi devstack@n-api.service[127628]: [pid: 127628|app: 0|req: 590/1163] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 10:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2005908445 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)